AVP, AI Quality & Reliability Engineering

Posted 12 Days Ago
Be an Early Applicant
55435, Minneapolis, MN, USA
In-Office
157K-290K Annually
Senior level
Analytics • Consulting
The Role
Lead enterprise AI Quality Engineering strategy and operations, creating validation frameworks, runtime assurance, synthetic test data and simulation platforms, and governance-aligned quality practices. Partner across engineering, clinical, security, data, and governance teams to ensure secure, compliant, observable, and scalable AI deployments in healthcare while driving organizational transformation, tooling evaluation, and team development.
Summary Generated by Built In

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

In this role you will lead the strategy, operationalization, governance alignment, and continuous evolution of enterprise AI Quality Engineering capabilities across Vizient. You will establish scalable AI Quality Engineering operating models, validation frameworks, runtime quality practices, synthetic data ecosystems, simulation-driven testing capabilities, and enterprise quality standards supporting responsible industrialization of AI-powered business solutions at enterprise scale and enterprise AI test data modernization, synthetic data platforms, healthcare digital simulation ecosystems, and hospital twin capabilities supporting secure, realistic, and scalable AI validation. You will Partner closely with AI Engineering & Delivery, AI Operations, Governance, Security, Clinical, Data, and Business teams to ensure AI solutions are secure, reliable, observable, compliant, scalable, and aligned with enterprise quality and healthcare operational expectations. In this role you will combine enterprise quality engineering leadership, AI-enabled testing modernization, healthcare workflow validation, governance alignment, and cross-functional organizational leadership.

AI Quality Engineering Leadership

  • Lead enterprise AI Quality Engineering initiatives across Vizient, including AI-powered applications, LLM-enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
  • Establish and mature AI Quality Engineering capabilities, including AI-native testing strategies, validation frameworks, runtime assurance practices, scalable operating models, and reusable quality accelerators.
  • Modernize traditional Quality Engineering practices to support AI-enabled workflows, probabilistic systems, intelligent orchestration, and evolving healthcare operational workflows.
  • Define enterprise AI quality standards, testing methodologies, validation approaches, release readiness criteria, and governance-aligned quality practices supporting scalable AI adoption across the enterprise.
  • Provide executive oversight across AI validation, quality engineering, test automation, runtime quality monitoring, release readiness, and quality improvement initiatives.
  • Lead organizational transformation efforts supporting the evolution of traditional QA capabilities toward AI-native quality engineering and simulation-driven validation practices.

AI Validation, Testing & Runtime Assurance

  • Lead enterprise AI validation strategies, including functional validation, prompt testing, workflow testing, regression testing, runtime quality assurance, and production reliability practices.
  • Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, and Data teams to establish scalable quality engineering processes supporting enterprise AI development lifecycle management and production operationalization.
  • Support enterprise AI runtime quality practices, including telemetry integration, monitoring alignment, incident coordination, release validation, deployment readiness assessments, and runtime reliability improvement initiatives.
  • Drive modernization of enterprise test automation capabilities leveraging AI-assisted testing, intelligent automation, reusable testing accelerators, scalable quality engineering frameworks, and measurable quality metrics.
  • Support enterprise AI observability and evaluation initiatives to improve reliability, traceability, runtime visibility, and operational confidence across AI-enabled systems.
  • Collaborate with Clinical, Operational, and Engineering stakeholders to support validation approaches for healthcare workflows, payer operations, and AI-enabled business processes.

AI Test Data, Synthetic Data & Simulation Platforms

  • Lead enterprise strategies supporting AI test data modernization, synthetic data capabilities, simulation environments, and scalable testing ecosystems enabling secure, realistic, and enterprise-grade AI validation.
  • Oversee development of enterprise synthetic test data platforms, healthcare simulation ecosystems, and hospital twin environments supporting AI engineering, testing, validation, and deployment readiness.
  • Partner with Data, Clinical, Engineering, Security, Governance, and AI teams to support scalable simulation frameworks, realistic operational testing scenarios, PHI-safe validation environments, and AI-enabled testing acceleration initiatives.
  • Support development of simulated healthcare operational environments and hospital twin capabilities enabling workflow validation, operational stress testing, scenario simulation, and safe evaluation of AI-enabled healthcare processes.
  • Drive scalable approaches for synthetic data governance, simulation fidelity, test environment automation, and secure testing ecosystem management within regulated healthcare environments.

Governance, Risk & Responsible AI

  • Partner with AI Governance, Risk, Compliance, Security, Clinical, and Operational stakeholders to support responsible AI practices, operational safeguards, human oversight controls, validation traceability, auditability, and secure deployment of AI solutions.
  • Support development and implementation of enterprise AI quality controls, validation evidence processes, testing governance frameworks, risk mitigation practices, and quality review standards aligned with enterprise and regulatory expectations.
  • Help establish scalable processes supporting secure, compliant, reliable, and measurable AI solution deployment within regulated healthcare environments.

Portfolio, Delivery & Organizational Scaling

  • Lead AI Quality Engineering portfolio activities, including organizational planning, vendor coordination, contractor oversight, delivery prioritization, execution governance, and scalable capability development.
  • Partner with enterprise stakeholders to evaluate implementation readiness, quality risks, scalability considerations, testing feasibility, and delivery dependencies for prioritized AI initiatives.
  • Support tooling evaluations, platform assessments, automation strategies, and modernization initiatives supporting enterprise AI Quality Engineering maturity.
  • Define scalable squad structures, delivery engagement models, support processes, and governance approaches supporting enterprise AI transformation initiatives.
  • Help drive organizational capability development, workforce maturation, operating model evolution, and enterprise adoption of modern AI Quality Engineering practices.

Leadership, Communication & Culture

  • Lead, mentor, and develop quality engineering leaders, managers, engineers, analysts, and contractor teams while fostering a collaborative, continuously learning, and engineering-driven culture.
  • Communicate quality risks, testing strategies, governance implications, implementation tradeoffs, and strategic recommendations effectively to both technical and executive stakeholders.
  • Promote a culture of engineering excellence, continuous improvement, enterprise accountability, responsible AI adoption, and operational discipline.
  • Research and evaluate emerging AI quality engineering, testing, observability, validation, simulation, automation, and runtime assurance technologies supporting innovation and continuous improvement initiatives.

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $156,500.00 to $290,100.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Skills Required

  • Leadership of enterprise AI quality engineering and validation programs
  • Design and implement AI-native testing strategies, validation frameworks, and runtime assurance
  • Experience with synthetic test data platforms, simulation environments, and hospital twin development
  • Expertise in test automation, AI-assisted testing, and scalable quality engineering frameworks
  • Knowledge of AI observability, telemetry integration, runtime monitoring, and incident coordination
  • Experience partnering with Governance, Security, Clinical, Data, and AI Operations teams for compliance and risk mitigation
  • Ability to define enterprise quality standards, release readiness criteria, and validation evidence processes
  • Proven experience scaling teams, vendor coordination, and delivery governance for AI initiatives
  • Familiarity with PHI-safe validation environments and regulatory expectations in healthcare
  • Strong communication and executive-level stakeholder management skills

Vizient Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Vizient and has not been reviewed or approved by Vizient.

  • Leave & Time Off Breadth Time off allowances are generous, with ample PTO and holidays available from day one. Separate paid volunteer days add additional protected time away.
  • Flexible Benefits Flexibility to work from anywhere for part of the year and hybrid options support work-life balance. Policies enabling remote periods complement the broader PTO structure.
  • Retirement Support Retirement benefits include a competitive 401(k) company match alongside HSA contributions on eligible plans. These elements strengthen long-term financial security within the total rewards package.

Vizient Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Irving, TX
5,661 Employees
Year Founded: 1977

What We Do

Vizient, Inc., the nation’s largest health care performance improvement company, serves more than 50% of the nation’s acute care providers, which includes 97% of the nation’s academic medical centers, and more than 20% of ambulatory care providers. Vizient provides expertise, analytics and advisory services, as well as a contract portfolio that represents more than $130 billion in annual purchasing volume. Vizient is based in Dallas and has offices in 20 metropolitan areas across the United States. We have 4,000 employees with a breadth of expertise, experience and compassion, who are eager to develop and implement solutions that advance health care for the greater good.

Similar Jobs

Jellyfish Logo Jellyfish

Data Architect

Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Remote or Hybrid
United States
225 Employees
200K-260K Annually

Jellyfish Logo Jellyfish

Data Engineer

Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Remote or Hybrid
United States
225 Employees
165K-205K Annually

Jellyfish Logo Jellyfish

Senior Software Engineer

Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Remote or Hybrid
United States
225 Employees
165K-235K Annually

Jellyfish Logo Jellyfish

Senior Platform Engineer

Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Remote or Hybrid
United States
225 Employees
165K-235K Annually

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account