Lead data design, prototype, and development of data pipeline architecture pipelines. Lead implementation of internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability. Lead cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions. Excellent analytic skills associated with working on unstructured datasets. Understand the architecture, be a team player, lead technical discussions and communicate the technical discussion. Be a senior Individual contributor of the Data or Software Engineering teams. Be part of Technical Review Board along with Manager and Principal Engineer. Be a technical liaison between Manager, Software Engineers and Principal Engineers. Collaborate with software engineers to analyze, develop and test functional requirements. Serve as a hands-on technical leader who actively designs, develops, reviews, and optimizes production-grade data pipelines, data products, and platform capabilities. Maintain significant contribution to production codebases while establishing engineering standards, mentoring team members, and driving delivery of scalable, resilient solutions. Mentor and Coach Engineers. Work with team members to investigate design approaches, prototype new technology and evaluate technical feasibility. Work in an Agile/Safe/Scrum environment to deliver high quality software. Establish architectural principles, select design patterns, and then mentor team members on their appropriate application. Facilitate and drive communication between front-end, back-end, data and platform engineers. Play a formal Engineering lead role in the area of expertise. Keep up-to-date with industry trends and developments.
Key Responsibilities:
These positions are hands-on engineering roles. In this role, employees are expected to actively design, develop, review, and optimize production code and platform capabilities while providing technical leadership and mentorship to engineering teams.
Bachelor’s Degree in Computer Science/Engineering or related field with 6 years of experience OR an Associate’s degree in Computer Science/Engineering or related field with 8 years of experience. Knowledge of professional software engineering practices and best practices for the full software development life cycle (SDLC), including coding standards, code reviews, source control management, build processes, testing, and operations. Have in-depth knowledge of data engineering and building data pipelines with a minimum of 5 years of experience in data engineering, data science or analytical modeling and basic knowledge of related disciplines. Worked and lead Data Engineering teams in Continuous Integration / Continuous Delivery model. Build/Lead Data products highly resilient in nature. Build/Lead Test Automation suites, Unit Testing coverage, Data Quality, Monitoring & Observability. A minimum experience of 5 years using relational databases and NoSQL Databases. Experience with cloud platforms such as GCP, Azure, AWS.
Continuous Integration using Jenkins, Git Hub Actions or Azure Pipelines. Experience with cloud technologies, development and deployment. Experience with tools like Jira, GitHub, SharePoint, Azure Boards. Experience using advanced data processing solutions/capabilities such as Apache Spark, Hive, Airflow and Kafka, GCP Dataflow. Experience using big data, statistics and knowledge of data related aspects of machine learning. Experience with Google BigQuery, FHIR APIs, and Vertex AI. Knowledge of how workflow scheduling solutions such as Apache Airflow and Google Composer related to data systems. Knowledge of using Infrastructure as code (Kubernetes, Docker) in a cloud environment.
The preferred candidate will possess:
- Advanced proficiency in Python and SQL with demonstrated experience building and supporting production-grade solutions.
- Advanced experience designing and implementing scalable distributed computing solutions using technologies such as Spark, Flink, Ray, or comparable frameworks.
- Deep understanding of cloud-agnostic architecture principles and modern data platform design.
- Advanced experience with open data architecture technologies including Apache Iceberg, Delta Lake, and Apache Hudi.
- Strong expertise with modern analytical data formats including Parquet, Avro, and ORC.
- Experience designing data platforms that support analytics, AI/ML, and operational workloads at enterprise scale.
- Experience implementing CI/CD, automated testing, Infrastructure-as-Code, observability, and engineering best practices.
- Experience designing systems for scalability, reliability, security, resiliency, and long-term maintainability.
Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.
- Medical: Multiple plan options.
- Dental: Delta Dental or reimbursement account for flexible coverage.
- Vision: Affordable plan with national network.
- Pre-Tax Savings: HSA and FSAs for eligible expenses.
- Retirement: Competitive retirement package to secure your future.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law". Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.
Skills Required
- Bachelor's degree in Computer Science/Engineering (6 years experience) or Associate's degree with 8 years experience
- In-depth knowledge of professional software engineering practices and full SDLC (coding standards, code reviews, source control, build, testing, operations)
- Minimum 5 years experience in data engineering, data science, or analytical modeling
- Experience leading Data Engineering teams in a CI/CD model
- Experience building/leading test automation suites, unit testing, data quality, monitoring and observability
- Minimum 5 years using relational databases and NoSQL databases
- Experience with cloud platforms (GCP, Azure, AWS) and cloud development/deployment
- Continuous integration experience using Jenkins, GitHub Actions, or Azure Pipelines
- Experience with tools such as Jira, GitHub, SharePoint, Azure Boards
- Experience with advanced data processing solutions (Apache Spark, Hive, Airflow, Kafka, GCP Dataflow)
- Experience with big data, statistics, and data aspects of machine learning
- Experience with Google BigQuery, FHIR APIs, and Vertex AI
- Knowledge of workflow scheduling solutions such as Apache Airflow and Google Composer
- Knowledge of containerization and infrastructure technologies (Kubernetes, Docker) and Infrastructure-as-Code in cloud environments
- Advanced proficiency in Python and SQL
- Advanced experience designing and implementing scalable distributed computing solutions (Spark, Flink, Ray or comparable)
- Experience with open data architecture technologies (Apache Iceberg, Delta Lake, Apache Hudi)
- Expertise with analytical data formats (Parquet, Avro, ORC)
- Experience designing data platforms supporting analytics, AI/ML, and operational workloads at enterprise scale
- Experience implementing CI/CD, automated testing, IaC, observability, and engineering best practices
- Experience designing systems for scalability, reliability, security, resiliency, and maintainability
Mayo Clinic Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mayo Clinic and has not been reviewed or approved by Mayo Clinic.
-
Retirement Support — A no-cost pension plus an employer-matched 403(b)/401(k) is positioned as a standout differentiator, offering strong long-term financial security. Feedback suggests this retirement combination elevates overall total rewards even when base pay is moderate.
-
Healthcare Strength — Expanded medical networks, enhanced fertility coverage, and employer absorption of a plan year’s premium increases point to robust healthcare offerings. Feedback suggests annual updates maintain breadth and competitiveness of coverage.
-
Parental & Family Support — Adoption assistance, dependent scholarships, child and elder-care resources, and EAP services provide meaningful family-oriented support. Feedback suggests these programs add tangible value beyond salary alone.
Mayo Clinic Insights
What We Do
Mayo Clinic is the first and largest integrated, not-for-profit medical group practice in the world. Doctors from every medical specialty work together to care for patients, joined by common systems and a philosophy of "the needs of the patient come first." More than 3,800 physicians and scientists and 50,900 allied health staff work at Mayo Clinic, which has sites in Rochester, Minn., Jacksonville, Fla., and Scottsdale/Phoenix, Ariz. Mayo Clinic also serves over 70 communities through Mayo Clinic Health System with locations in MN, IA, and WI. Collectively, these locations care for more than 1 million people each year.
