Lead Architect, AI Quality Engineering

Posted Yesterday
Be an Early Applicant
55435, Minneapolis, MN, USA
In-Office
Senior level
Analytics • Consulting
The Role
Lead architecture and implementation of AI Quality Engineering and workflow optimization for enterprise AI systems. Design scalable AI validation frameworks, runtime quality controls, testing pipelines, and human-in-the-loop workflows. Partner with engineering, governance, clinical, and data teams to drive observability, automation, and reliable AI deployment. Mentor teams, coordinate delivery, evaluate tooling, and promote responsible, scalable AI quality practices.
Summary Generated by Built In

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

AI Quality Engineering Architecture & Workflow Optimization

  • Lead architecture and technical implementation of AI Quality Engineering solutions supporting AI-powered applications, LLM-enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
  • Design and implement scalable AI validation frameworks, AI-assisted testing approaches, runtime quality controls, reusable testing accelerators, and workflow optimization capabilities supporting enterprise AI delivery initiatives.
  • Support modernization of traditional Quality Engineering practices through intelligent automation, workflow orchestration, and scalable quality engineering patterns.
  • Develop automated validation approaches, anomaly detection processes, testing pipelines, and quality metrics supporting governance-aligned AI deployment practices.
  • Design and optimize human-in-the-loop validation workflows, operational review processes, and AI quality assurance controls supporting reliable and scalable AI-enabled systems.
  • Partner with engineering and business teams to identify operational bottlenecks, workflow optimization opportunities, automation use cases, and scalable quality engineering improvements.

AI Validation, Runtime Assurance & Automation

  • Support AI validation activities, including prompt testing, workflow testing, regression testing, runtime quality assurance, and production reliability support.
  • Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, and Data teams to support scalable AI Quality Engineering and workflow automation processes across enterprise AI initiatives.
  • Design and support runtime quality practices, including telemetry alignment, monitoring coordination, validation processes, and runtime reliability improvement efforts.
  • Drive adoption of AI-assisted testing approaches, intelligent automation, reusable testing accelerators, and orchestration-aware testing practices.
  • Support observability and runtime visibility initiatives improving reliability, traceability, and confidence across AI-enabled systems.
  • Collaborate with Clinical, Operational, and Engineering stakeholders to support validation of healthcare workflows, operational processes, and AI-enabled business solutions.

Technical Enablement, Delivery & Operational Support

  • Support delivery coordination activities across AI Quality Engineering and workflow optimization initiatives, including implementation planning, issue tracking, operational support, and release coordination activities.
  • Partner with stakeholders to evaluate implementation readiness, workflow dependencies, operational risks, automation opportunities, and quality considerations for AI initiatives.
  • Support tooling evaluations, automation frameworks, orchestration tooling, and modernization initiatives supporting AI Quality Engineering maturity.
  • Help establish reusable workflow automation patterns, scalable testing assets, and engineering enablement practices across delivery teams.
  • Support adoption of modern AI Quality Engineering and workflow optimization practices across engineering and business organizations.

Leadership, Collaboration & Continuous Improvement

  • Lead and mentor engineers, analysts, contractors, and delivery teams while fostering a collaborative, continuously learning, and engineering-focused culture.
  • Communicate implementation risks, workflow optimization opportunities, technical tradeoffs, and operational recommendations to technical and business stakeholders.
  • Promote engineering discipline, continuous improvement, responsible AI adoption, and operational accountability across AI Quality Engineering initiatives.

Research and evaluate emerging AI quality engineering, workflow automation, observability, and runtime assurance technologies supporting continuous improvement initiatives.

Estimated Hiring Range:

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Skills Required

  • Lead architecture and implementation of AI Quality Engineering solutions (LLM-enabled workflows, agentic systems, enterprise AI platforms)
  • Design and implement AI validation frameworks, testing pipelines, runtime quality controls, and anomaly detection
  • Develop and support human-in-the-loop validation workflows and operational review processes
  • Drive adoption of AI-assisted testing approaches, reusable testing accelerators, and orchestration-aware testing practices
  • Partner with AI Engineering, LLMOps, AIOps, Security, Governance, Clinical, and Data teams for cross-functional delivery
  • Support observability, telemetry alignment, and runtime reliability/monitoring initiatives
  • Lead, mentor, and collaborate with engineers, analysts, contractors, and delivery teams
  • Evaluate tooling, automation frameworks, and orchestration tooling to modernize quality engineering practices

Vizient Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Vizient and has not been reviewed or approved by Vizient.

  • Leave & Time Off Breadth Time off allowances are generous, with ample PTO and holidays available from day one. Separate paid volunteer days add additional protected time away.
  • Flexible Benefits Flexibility to work from anywhere for part of the year and hybrid options support work-life balance. Policies enabling remote periods complement the broader PTO structure.
  • Retirement Support Retirement benefits include a competitive 401(k) company match alongside HSA contributions on eligible plans. These elements strengthen long-term financial security within the total rewards package.

Vizient Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Irving, TX
5,661 Employees
Year Founded: 1977

What We Do

Vizient, Inc., the nation’s largest health care performance improvement company, serves more than 50% of the nation’s acute care providers, which includes 97% of the nation’s academic medical centers, and more than 20% of ambulatory care providers. Vizient provides expertise, analytics and advisory services, as well as a contract portfolio that represents more than $130 billion in annual purchasing volume. Vizient is based in Dallas and has offices in 20 metropolitan areas across the United States. We have 4,000 employees with a breadth of expertise, experience and compassion, who are eager to develop and implement solutions that advance health care for the greater good.

Similar Jobs

Enverus Logo Enverus

Manager, Power Markets

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
5 Locations
1800 Employees
115K-130K Annually

MetLife Logo MetLife

Business Procedures Analyst

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-72K Annually

Crunchyroll Logo Crunchyroll

Communications Senior Manager, Asia

Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
Remote or Hybrid
21 Locations
1300 Employees

Applied Systems Logo Applied Systems

Senior User Experience Designer

Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Remote or Hybrid
4 Locations
3040 Employees
100K-130K Annually

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account