Associate AI/ML Engineer- Post Deployment Governance

Posted Yesterday
Rochester, MN, USA
In-Office
Entry level
Healthtech
The Role
Supports post-deployment governance for clinical and operational AI products. Responsibilities include building evidence and lineage maps, reviewing monitoring and reporting readiness, checking completeness and traceability, documenting evidence gaps and limitations, organizing review packages, tracking actions and lifecycle handoffs, and coordinating with technical, clinical, operational, vendor, and governance stakeholders.
Summary Generated by Built In

Associate AI/ML Engineers in AI Validation & Monitoring (AVM) support the enterprise clinical AI governance review and consultation function for post-deployment monitoring, reporting, measurement, and lifecycle evidence. Working under the guidance of more senior team members, they collaborate with AIA Governance Operations, product and operational teams, clinicians, data and platform partners, vendors, Governance Technology, and other stakeholders to organize evidence, apply approved methods, identify completeness and traceability gaps, and prepare decision-ready review materials that support safe, effective, and accountable use of AI in clinical and operational settings.

As the Associate AI/ML Engineer - Post-Deployment Governance, serving in the functional assignment of Monitoring, Reporting, and Lifecycle Enablement, you will prepare product-level evidence maps connecting required signals to source systems, owners, cadence, product and model versions, limitations, Post-Deployment Monitoring (PDM) and Post-Deployment Report Summary (PDRS) domains, actions, and handoffs. You will support monitoring and reporting readiness across full implementation, recurring reporting, post-deployment changes, and legacy products; collect and structure evidence using approved templates, checklists, and readiness methods; and prepare draft AVM comments, review findings, consultation materials, and escalation packages.  

  • Preparing and maintaining product evidence and lineage maps that connect monitoring signals, metrics, source systems, owners, cadence, collection methods, product and model versions, limitations, PDM and PDRS domains, actions, and reporting handoffs.
  • Supporting monitoring and reporting readiness reviews for full implementation, recurring PDRS, post-deployment changes, and legacy products by applying approved templates, checklists, rubrics, evidence requirements, and readiness criteria.
  • Performing completeness and traceability checks for sources, owners, cadence, versions, limitations, baselines, targets, thresholds, conditions, actions, and transition information; identifying missing, inconsistent, or unsupported evidence for assigned reviewers.
  • Reviewing PDM and PDRS content and drafting factual corrections, clarification questions, evidence-gap and limitation summaries, standard AVM comments, and monitoring-readiness findings.
  • Organizing PDRS review packages, evidence references, owner and source matrices, action and condition trackers, follow-up records, ownership verification, lifecycle handoff materials, and transition plans.
  • Supporting post-deployment change and legacy-product reviews by tracing version, metric, baseline, threshold, monitoring-continuity, reporting-cadence, evidence-gap, and interim-control impacts for Engineer or Principal review.
  • Coordinating evidence and status information with Product Leads, product and operational owners, data and platform partners, vendors, and other stakeholders; escalating substantive interpretation, unresolved risk, or complex PDM and PDRS questions. 

    This vacancy is not eligible for sponsorship/ we will not sponsor or transfer visas for this position. Also, Mayo Clinic DOES NOT participate in the F-1 STEM OPT extension program.
     

Qualifications
  •  A bachelor’s degree in engineering, computer science, health science, or a related field
  • Knowledge in applying AI and machine learning in production environments, showcasing an understanding of healthcare technology.
  • Knowledge in cloud infrastructure environment and software development tools.
  • Skill in AI/ML techniques and frameworks.
  • Skill in collaborating across diverse teams and effectively communicating complex technical concepts to non-technical stakeholders.
  • Familiarity with best practices in data engineering, data science, AI Engineering, and the MLOps communities.
  • Strong interpersonal, communication, and time management skills.
     

Preferred Qualifications: 

  • Knowledge of the healthcare domain, including clinical workflows, electronic health records, medical terminologies, regulatory requirements, and industry standards.
  • Familiarity with systems or quality engineering best practices, regulatory standards, and compliance frameworks, with the ability to adapt these effectively to different project scenarios.
  • Experience in user-centered design, human factors engineering, usability testing methodologies, and evaluation across AI product development. Ability to conduct expert reviews using established usability practices and methods. Presents findings in easy-to-understand terms for the business or clinical practice.
  • Ability to articulate complex technical concepts to diverse audiences, facilitating clear understanding and engagement from technical and non-technical stakeholders.
  • Ability to manage a varied workload of projects with multiple priorities and stay current on healthcare trends.
  • Demonstrated hands-on experience using the TRex assessment application to build evidence maps, verify post-deployment monitoring readiness, ownership, cadence, versions, limitations, and lifecycle handoffs for AI tools deployed in Epic, ANIMATE, and comparable clinical environments. 
About Us
Why Mayo Clinic

Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.

Benefits Highlights
  • Medical: Multiple plan options.
  • Dental: Delta Dental or reimbursement account for flexible coverage.
  • Vision: Affordable plan with national network.
  • Pre-Tax Savings: HSA and FSAs for eligible expenses.
  • Retirement: Competitive retirement package to secure your future.
About the Team
Just as our reputation has spread beyond our Minnesota roots, so have our locations. Today, our employees are located at our three major campuses in Phoenix/Scottsdale, Arizona, Jacksonville, Florida, Rochester, Minnesota, and at Mayo Clinic Health System campuses throughout Midwestern communities, and at our international locations. Each Mayo Clinic location is a special place where our employees thrive in both their work and personal lives. Learn more about what each unique Mayo Clinic campus has to offer, and where your best fit is. 

Equal Opportunity

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law".  Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.

Skills Required

  • Bachelor's degree in engineering, computer science, health science, or a related field
  • Knowledge of applying AI and machine learning in production environments
  • Understanding of healthcare technology
  • Knowledge of cloud infrastructure environments and software development tools
  • Skill in AI/ML techniques and frameworks
  • Ability to collaborate across diverse teams and communicate complex technical concepts to non-technical stakeholders
  • Familiarity with data engineering, data science, AI engineering, and MLOps best practices
  • Strong interpersonal, communication, and time management skills
  • Knowledge of healthcare domains, including clinical workflows, electronic health records, medical terminologies, regulatory requirements, and industry standards
  • Familiarity with systems or quality engineering practices, regulatory standards, and compliance frameworks
  • Experience with user-centered design, human factors engineering, usability testing, and AI product evaluation
  • Ability to manage multiple priorities and stay current on healthcare trends
  • Hands-on experience using the TRex assessment application for AI evidence mapping and post-deployment monitoring readiness
  • Experience with AI tools deployed in Epic, ANIMATE, or comparable clinical environments

Mayo Clinic Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mayo Clinic and has not been reviewed or approved by Mayo Clinic.

  • Retirement Support A no-cost pension plus an employer-matched 403(b)/401(k) is positioned as a standout differentiator, offering strong long-term financial security. Feedback suggests this retirement combination elevates overall total rewards even when base pay is moderate.
  • Healthcare Strength Expanded medical networks, enhanced fertility coverage, and employer absorption of a plan year’s premium increases point to robust healthcare offerings. Feedback suggests annual updates maintain breadth and competitiveness of coverage.
  • Parental & Family Support Adoption assistance, dependent scholarships, child and elder-care resources, and EAP services provide meaningful family-oriented support. Feedback suggests these programs add tangible value beyond salary alone.

Mayo Clinic Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Rochester, MN
54,000 Employees

What We Do

Mayo Clinic is the first and largest integrated, not-for-profit medical group practice in the world. Doctors from every medical specialty work together to care for patients, joined by common systems and a philosophy of "the needs of the patient come first."​ More than 3,800 physicians and scientists and 50,900 allied health staff work at Mayo Clinic, which has sites in Rochester, Minn., Jacksonville, Fla., and Scottsdale/Phoenix, Ariz. Mayo Clinic also serves over 70 communities through Mayo Clinic Health System with locations in MN, IA, and WI. Collectively, these locations care for more than 1 million people each year.

Similar Jobs

In-Office
Rochester, MN, USA
54000 Employees

PNC Bank Logo PNC Bank

Technology Solution Center Analyst Lead

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
41K-83K Annually

PNC Bank Logo PNC Bank

Software Engineer

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees

Enverus Logo Enverus

Sales Compensation Specialist - 26356

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
4 Locations
1800 Employees
90K-105K Annually

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account