This is a hybrid position and must be located within 100 miles of a Mayo Clinic campus for occasional on-site expectations based on business needs.
As a Senior Software Engineer for AI Platform Engineering, you will bridge the gap between high-scale systems architecture and frontier AI. You will be one of architects and builders of our Model & Agent Runtimes—the specialized engines that govern how models and autonomous agents execute across our hybrid-cloud footprint.
This isn't just about deployment; it’s about a platform-first mindset. You will ensure that AI capabilities are scalable, secure, and governed through world-class AgentOps, LLMOps, and MLOps practices.
What You’ll Do
- Architect the Future of Runtimes: Design and implement high-performance hosting environments for both specialized models and autonomous agents.
- Scale Hybrid-Cloud Infrastructure: Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments.
- Drive Operational Excellence: Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production.
- Operational Stewardship: Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services.
- Collaborate & Advocate: Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value.
What You’ll Bring
- Deep Systems Expertise: Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (Kubernetes).
- AI/ML Fluency: Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures.
- Operational Rigor: A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments.
- Problem-Solving Mindset: The ability to turn abstract AI research into production-grade, hardened platform features.
Why this team? We are moving beyond simple model serving. We are building the foundational "nervous system" for autonomous agents in a high-stakes environment where performance and governance are non-negotiable.
QualificationsRequired qualifications for this position include: Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate’s degree in Computer/Science/Engineering or related field with 7 years of experience.
Have in-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fields. Demonstrated problem solving and time management skills. Possesses strong technical aptitude for designing and implementing software solutions. Experience with modern application development frameworks. Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations. Deep hands-on technical expertise, excellent verbal and written communication skills. Experience with Agile software development techniques.
Preferred qualifications:
- Master's degree in Computer Science/Engineering or related field.
- Ability to use a wide variety of open-source technologies and cloud-based services.
- Experience writing software for the cloud (GCP, AWS, Azure).
- Experience in databases, analytics, big data systems or business intelligence products.
- Experience building high-performance, highly available and scalable distributed systems.
- Experience developing software for healthcare related industries.
Authorization to work and remain in the United States, without necessity for Mayo Clinic sponsorships now, or in the future (for example, be a U.S. Citizen, national, or permanent resident, refugee, or asylee). Mayo Clinic does not participate in the F-1 STEM OPT extension program.
About UsMayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.
- Medical: Multiple plan options.
- Dental: Delta Dental or reimbursement account for flexible coverage.
- Vision: Affordable plan with national network.
- Pre-Tax Savings: HSA and FSAs for eligible expenses.
- Retirement: Competitive retirement package to secure your future.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law". Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.
Skills Required
- Bachelor’s degree in Computer Science, Engineering, or a related field and 5 years of relevant experience
- Alternatively, an Associate’s degree in Computer Science, Engineering, or a related field and 7 years of relevant experience
- In-depth software engineering knowledge and experience coding applications or services in a high-level programming language, preferably Python
- Experience with modern application development frameworks
- Knowledge of software engineering best practices across the full software development lifecycle, including coding standards, code reviews, source control, build processes, testing, and operations
- Strong technical aptitude for designing and implementing software solutions
- Problem-solving and time-management skills
- Deep hands-on technical expertise and strong verbal and written communication skills
- Experience with Agile software development techniques
- Master’s degree in Computer Science, Engineering, or a related field
- Experience using open-source technologies and cloud-based services
- Experience writing software for GCP, AWS, or Azure
- Experience with databases, analytics, big data systems, or business intelligence products
- Experience building high-performance, highly available, scalable distributed systems
- Experience developing software for healthcare-related industries
- Authorization to work and remain in the United States without current or future Mayo Clinic sponsorship
Mayo Clinic Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mayo Clinic and has not been reviewed or approved by Mayo Clinic.
-
Retirement Support — A no-cost pension plus an employer-matched 403(b)/401(k) is positioned as a standout differentiator, offering strong long-term financial security. Feedback suggests this retirement combination elevates overall total rewards even when base pay is moderate.
-
Healthcare Strength — Expanded medical networks, enhanced fertility coverage, and employer absorption of a plan year’s premium increases point to robust healthcare offerings. Feedback suggests annual updates maintain breadth and competitiveness of coverage.
-
Parental & Family Support — Adoption assistance, dependent scholarships, child and elder-care resources, and EAP services provide meaningful family-oriented support. Feedback suggests these programs add tangible value beyond salary alone.
Mayo Clinic Insights
What We Do
Mayo Clinic is the first and largest integrated, not-for-profit medical group practice in the world. Doctors from every medical specialty work together to care for patients, joined by common systems and a philosophy of "the needs of the patient come first." More than 3,800 physicians and scientists and 50,900 allied health staff work at Mayo Clinic, which has sites in Rochester, Minn., Jacksonville, Fla., and Scottsdale/Phoenix, Ariz. Mayo Clinic also serves over 70 communities through Mayo Clinic Health System with locations in MN, IA, and WI. Collectively, these locations care for more than 1 million people each year.
