Manager, AI Quality & Reliability Engineering

Posted Yesterday
Be an Early Applicant
3 Locations
In-Office
89K-156K Annually
Senior level
Analytics • Consulting
The Role
Lead AI Quality Engineering initiatives for enterprise AI, establishing AI-native testing, validation, runtime quality controls, observability, and automation. Coordinate cross-functional validation, release readiness, and production reliability for LLM-enabled workflows and AI platforms. Mentor teams and drive adoption of AI-assisted testing, telemetry analysis, and continuous improvement across healthcare-related AI solutions.
Summary Generated by Built In

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Summary

In this role, you will lead the day-to-day execution and delivery of AI Quality Engineering initiatives supporting Vizient's enterprise AI transformation efforts. You will help establish and scale AI Quality Engineering practices, validation processes, AI-assisted testing approaches, runtime quality controls, and modern testing frameworks that support the responsible deployment of AI-powered business solutions. This role combines hands-on quality engineering leadership, AI-enabled testing modernization, healthcare workflow validation, team leadership, and cross-functional delivery coordination to ensure the reliability, performance, and governance of AI-enabled systems.

Responsibilities

  • Lead day-to-day AI Quality Engineering activities supporting AI-powered applications, LLM-enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
  • Implement and mature AI Quality Engineering practices, including AI-native testing approaches, validation processes, runtime quality controls, reusable testing accelerators, and scalable testing frameworks.
  • Coordinate AI validation efforts, including functional testing, prompt testing, workflow validation, regression testing, defect management, release readiness, and production quality assurance.
  • Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to ensure scalable and effective quality engineering processes across AI initiatives.
  • Support runtime quality and reliability through observability, monitoring, telemetry analysis, incident support, drift detection, distributed tracing, and continuous improvement initiatives.
  • Drive adoption of AI-assisted testing, intelligent automation, reusable test assets, and modern quality engineering practices that improve efficiency and quality outcomes.
  • Lead delivery coordination activities including sprint execution, testing planning, issue tracking, risk identification, dependency management, and release support.
  • Collaborate with clinical, operational, and engineering stakeholders to validate healthcare workflows, payer operations, and AI-enabled business processes while supporting responsible AI deployment.
  • Mentor quality engineers, analysts, contractors, and delivery teams while fostering a culture of continuous learning, engineering excellence, and operational accountability.

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field preferred.
  • 7 or more years of experience in Quality Engineering, Software Testing, Quality Assurance, or related technology disciplines required.
  • Experience supporting AI-powered applications, machine learning solutions, LLM-enabled workflows, intelligent automation, or emerging AI technologies required.
  • Experience implementing test strategies, validation frameworks, automation solutions, and quality controls across complex enterprise technology environments required.
  • Knowledge of AI Quality Engineering concepts including AI validation, prompt testing, model evaluation, runtime assurance, observability, monitoring, and production reliability required.
  • Experience partnering with cross-functional teams including Engineering, Product, Data, Security, Governance, Clinical, and Operations stakeholders required.
  • Demonstrated ability to lead testing efforts, manage quality risks, coordinate releases, and support delivery across multiple initiatives required.
  • Strong analytical, problem-solving, and communication skills with the ability to translate technical quality concerns into actionable business recommendations required.
  • Experience within healthcare, payer, provider, or highly regulated industries preferred.
  • Experience with AI-assisted testing tools, test automation frameworks, observability platforms, and modern software delivery practices preferred.
  • You must be authorized to work in the United States without sponsorship.

#LI-JB1

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $88,900.00 to $155,500.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Skills Required

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field
  • 7 or more years of experience in Quality Engineering, Software Testing, Quality Assurance, or related technology disciplines
  • Experience supporting AI-powered applications, machine learning solutions, LLM-enabled workflows, intelligent automation, or emerging AI technologies
  • Experience implementing test strategies, validation frameworks, automation solutions, and quality controls across complex enterprise technology environments
  • Knowledge of AI Quality Engineering concepts including AI validation, prompt testing, model evaluation, runtime assurance, observability, monitoring, and production reliability
  • Experience partnering with cross-functional teams including Engineering, Product, Data, Security, Governance, Clinical, and Operations stakeholders
  • Demonstrated ability to lead testing efforts, manage quality risks, coordinate releases, and support delivery across multiple initiatives
  • Strong analytical, problem-solving, and communication skills with ability to translate technical quality concerns into business recommendations
  • Experience within healthcare, payer, provider, or highly regulated industries
  • Experience with AI-assisted testing tools, test automation frameworks, observability platforms, and modern software delivery practices
  • Authorized to work in the United States without sponsorship

Vizient Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Vizient and has not been reviewed or approved by Vizient.

  • Leave & Time Off Breadth Time off allowances are generous, with ample PTO and holidays available from day one. Separate paid volunteer days add additional protected time away.
  • Flexible Benefits Flexibility to work from anywhere for part of the year and hybrid options support work-life balance. Policies enabling remote periods complement the broader PTO structure.
  • Retirement Support Retirement benefits include a competitive 401(k) company match alongside HSA contributions on eligible plans. These elements strengthen long-term financial security within the total rewards package.

Vizient Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Irving, TX
5,661 Employees
Year Founded: 1977

What We Do

Vizient, Inc., the nation’s largest health care performance improvement company, serves more than 50% of the nation’s acute care providers, which includes 97% of the nation’s academic medical centers, and more than 20% of ambulatory care providers. Vizient provides expertise, analytics and advisory services, as well as a contract portfolio that represents more than $130 billion in annual purchasing volume. Vizient is based in Dallas and has offices in 20 metropolitan areas across the United States. We have 4,000 employees with a breadth of expertise, experience and compassion, who are eager to develop and implement solutions that advance health care for the greater good.

Similar Jobs

Corporate Tools LLC Logo Corporate Tools LLC

Flutter App Developer

eCommerce • Legal Tech • Professional Services • Software • Data Privacy
Remote or Hybrid
4 Locations
1200 Employees
150K-150K Annually

Enverus Logo Enverus

Manager, Power Markets

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
5 Locations
1800 Employees
115K-130K Annually

MetLife Logo MetLife

Business Procedures Analyst

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-72K Annually

Crunchyroll Logo Crunchyroll

Communications Senior Manager, Asia

Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
Remote or Hybrid
21 Locations
1300 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account