QA Automation Lead, AI & Data Platforms

Reposted 8 Days Ago
Be an Early Applicant
Hiring Remotely in Massachusetts
Remote
122K-166K Annually
Senior level
Healthtech • Machine Learning • Natural Language Processing • Other • Telehealth • Conversational AI • Generative AI
AI + cloud-first healthcare: building intelligent systems that empower physicians and transform patient outcomes.
The Role
The QA Automation Lead will design automation strategies for AI healthcare services, ensuring compliance with engineering standards and enhancing AI system reliability through test frameworks and CI/CD integration.
Summary Generated by Built In

Your Future is our Future

At Lumeris, we believe that our greatest achievements are made possible by the talent and commitment of our team members. That's why we are actively seeking talented and collaborative individuals who are passionate about making a difference in the healthcare industry. Join us today as we strive to create a system of care that every doctor wants for their own family and become part of a community that values its people and empowers you to make an impact.

Position:QA Automation Lead, AI & Data Platforms

Position Summary:The QA Automation Lead will design and drive the automation strategy for AI-driven healthcare services, including AI agents, Best Next Action (BNA), and supporting data pipelines. They will ensure that testing automation frameworks align with engineering standards and regulatory requirements for safe, explainable AI in healthcare. Acting as a bridge between software engineering and quality assurance, the QA Automation Lead will enhance the reliability and scalability of AI systems through robust test frameworks, automation suites, and CI/CD integration.

Job Description:

Responsibilities 

  • Design and implement end-to-end automation frameworks for AI/ML services and APIs. 
  • Lead automation coverage across patient store, data ingestion, and communication pipelines. 
  • Develop Python-based or TypeScript test suites integrated with ADO Actions, Jenkins, or similar. 
  • Collaborate with developers and data science to embed testing early in the delivery lifecycle. 
  • Integrate synthetic and production-like data for consistent AI validation. 
  • Establish metrics and dashboards (coverage, pass rate, execution time). 
  • Mentor QA engineers on automation best practices and code review standards. 

Qualifications 

  • Bachelor’s in Computer Science, Engineering, or equivalent. 
  • 5+ years in QA/QE automation. 
  • Strong Python or JavaScript/TypeScript experience. 
  • Familiar with RESTful APIs, Postman, and cloud (AWS/GCP). 
  • Experience with frameworks like PyTest, Cypress, Playwright, or Robot Framework. 
  • Knowledge of AI testing, data validation, or model QA a strong plus. 
  • Excellent understanding of CI/CD, Docker, and test data management. 
  • Knowledge of AI risk management frameworks (ISO 42001, NIST AI RMF). 

Healthcare or regulated data environment experience preferred

Pay Transparency:

Factors that may be used to determine your actual pay rate include your specific skills, experience, qualifications, location, and comparison to other employees already in this role. In addition to the base salary, certain roles may qualify for a performance-based incentive and/or equity, with eligibility depending on the position. These rewards are based on a combination of company performance and individual achievements.

The hiring range for this position is:

$122,335.00-$166,114.75

Benefits of working at Lumeris

  • Medical, Vision and Dental Plans

  • Tax-Advantage Savings Accounts (FSA & HSA)

  • Life Insurance and Disability Insurance

  • Paid Time Off (PTO, Sick Time, Paid Leave, Volunteer & Wellness Days)

  • Employee Assistance Program

  • 401k with company match

  • Employee Resource Groups

  • Employee Discount Program

  • Learning and Development Opportunities

  • And much more...

Be part of a team that is changing healthcare!

Member Facing Position: No- Not Member or Patient Facing Position

Location:Massachusetts

Time Type:Full time

Lumeris and its partners are committed to protecting our high-risk members & prospects when conducting business in-person. All personnel who interact with at-risk members or prospects are required to have completed, at a minimum, the initial series of an approved COVID-19 vaccine. If this role has been identified as member-facing, proof of vaccination will be required as a condition of employment.Disclaimer:
  • The job description describes the general nature and level of work being performed by people assigned to this job and is not intended to be an exhaustive list of all responsibilities, duties and skills required. The physical activities, demands and working conditions represent those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individual with disabilities to perform the essential job duties and responsibilities.
Lumeris is an EEO/AA employer M/F/V/D.

Top Skills

AWS
Ci/Cd
Cypress
Docker
GCP
JavaScript
Playwright
Postman
Pytest
Python
Restful Apis
Robot Framework
Typescript
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Maryland Heights, MO
1,001 Employees
Year Founded: 2001

What We Do

Lumeris is a tech-enabled value-based care company driving the future of healthcare through cloud-native platforms, AI, and data engineering. We partner with health systems, payers, and physicians nationwide to improve patient outcomes, lower costs, and reimagine the clinical experience.

At the center of our technology strategy is Tom™, an industry-first AI-powered platform built on Google Cloud Platform. Tom uses advanced generative AI, agentic systems, and predictive analytics to reduce administrative burden, deliver real-time clinical insights, and help physicians focus on patients—not paperwork.

Our engineers, data scientists, and clinicians work together to tackle challenges like:

Designing scalable data pipelines that unify disparate health data (EHR, HL7, FHIR).
Building and deploying production-grade AI/ML models on Vertex AI, BigQuery, and Dataflow.
Operationalizing MLOps and AI Ops frameworks for speed, reliability, and compliance.
Embedding LLM-powered agents into clinical workflows and patient-facing applications.
Applying cloud-first design principles with modern stacks (Kubernetes, Terraform, Docker) to ensure scalability, security, and interoperability.

With more than a decade of experience in value-based care, Lumeris combines deep healthcare expertise with a startup mindset in tech innovation. Every project directly impacts patient health, provider satisfaction, and the way care is delivered at scale.

Why Work With Us

For engineers and builders, Lumeris offers the chance to work on hard technical problems with real-world impact: data modeling at population scale, responsible generative AI in regulated environments, and modernizing clinical workflows for millions of patients.

Similar Jobs

CrowdStrike Logo CrowdStrike

Software Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
15 Locations
10000 Employees
120K-180K Annually

CrowdStrike Logo CrowdStrike

Back-end Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
15 Locations
10000 Employees
120K-180K Annually

ServiceNow Logo ServiceNow

Architect

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Waltham, MA, USA
28000 Employees
147K-258K Annually

Pfizer Logo Pfizer

Neuroscience Health and Science Professional - Boston S, MA

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
Massachusetts, USA
121990 Employees
72K-180K Annually

Similar Companies Hiring

Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account