QA Test Manager - AI

Reposted 16 Days Ago
Be an Early Applicant
3 Locations
In-Office
Senior level
Healthtech • Biotech • Pharmaceutical • Manufacturing
The Role
Lead QA for AI platforms by defining test strategy, automation, and quality governance. Design AI-specific and CI/CD-integrated test frameworks, validate agent behavior, manage QA team, enforce quality gates, drive metrics and continuous improvement across engineering and product teams.
Summary Generated by Built In
QA Test Manager - AI

ICON is a global healthcare intelligence and clinical research organisation united by a mission to bring new medicines and treatments to patients faster.


As a values-driven organisation, integrity, collaboration, agility, and inclusion are at the heart of how we work and interact with each other, customers, patients and suppliers.


IT Test Manager – AI Platforms

As an IT Test Manager at ICON, you will be responsible for leading the quality assurance capability across AI platforms, including the multi-agent framework, agent services, and central AI systems. You will ensure all solutions are delivered with high standards of quality, reliability, compliance, and performance.

What You Will Do:

In this role you will define and drive the testing strategy and quality governance model, embedding quality throughout the development lifecycle and enabling confident, high-quality releases.

Key Responsibilities:

  • Define and implement the overall test strategy covering functional, integration, regression, performance, and AI-specific testing
  • Design and manage test frameworks and automation strategies to support scalable, reliable testing across CI/CD pipelines
  • Lead testing approaches for AI-powered solutions, including validation of agent behaviour, outputs, and workflows
  • Build, manage, and develop a team of QA engineers, driving a strong quality-first culture across the organisation
  • Establish and enforce quality gates within release processes, ensuring all deliverables meet defined standards
  • Implement quality governance processes including defect management, root cause analysis, and continuous improvement
  • Monitor and report on quality metrics, providing insights to stakeholders and driving data-led improvements
  • Collaborate with engineering, product, and program teams to ensure testing is embedded early in development.
Your Profile:
  • Proven experience in software quality assurance, including leadership of QA teams or functions
  • Strong experience designing and implementing test strategies and automation frameworks
  • Experience working with CI/CD pipelines and embedding automated testing into delivery workflows
  • Understanding of testing approaches for modern applications, including APIs, microservices, and cloud-based platforms
  • Experience with AI/ML systems or an understanding of the challenges of testing non-deterministic outputs and complex workflows
  • Experience working in regulated or compliance-driven environments
  • Strong communication and stakeholder management skills, with the ability to influence cross-functional teams

#LI-JC3

#LI-Remote

#LI-Hybrid


Employment with ICON is contingent upon having the legal right to work in the country where the role is based.


Rewards & Benefits

ICON offers a competitive and comprehensive total rewards package designed to support your health, wellbeing, and career development.


Benefits may include:

  • Competitive base salary and performance related incentives
  • Health and wellbeing programmes including medical, dental, and vision coverage where applicable
  • Retirement and pension plans
  • Life assurance and disability coverage
  • Employee assistance programmes and wellbeing resources
  • Learning and development opportunities through structured training and career pathways

Benefits may vary depending on role and location.


Visit our careers site to read more about the benefits ICON offers.


Inclusion and Accessibility

ICON is an equal opportunity employer. We are committed to building an inclusive and accessible workplace where everyone feels valued and supported.


If you require reasonable accommodations during the recruitment process, please let us know or submit a request here.

Are you a current ICON Employee? Please click here to apply

Skills Required

  • Proven experience in software quality assurance, including leadership of QA teams or functions
  • Strong experience designing and implementing test strategies and automation frameworks
  • Experience working with CI/CD pipelines and embedding automated testing into delivery workflows
  • Understanding of testing approaches for modern applications, including APIs, microservices, and cloud-based platforms
  • Experience with AI/ML systems or understanding of challenges testing non-deterministic outputs and complex workflows
  • Experience working in regulated or compliance-driven environments
  • Strong communication and stakeholder management skills

ICON plc Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about ICON plc and has not been reviewed or approved by ICON plc.

  • Healthcare Strength Benefits are described as comprehensive, with medical coverage and wellness initiatives highlighted. Larger sites are also associated with added wellness supports such as onsite fitness options and access to an employee assistance program.
  • Leave & Time Off Breadth Time-off and flexibility provisions are positioned as a meaningful part of the total package, including vacation/annual leave and flexible work scheduling. Flexibility is sometimes cited as helping offset long hours in certain roles.
  • Retirement Support Retirement and savings support is presented as a core component of the benefits package, including offerings such as pension arrangements in some locations and a U.S. 401(k) plan with company match. Financial planning resources are also emphasized as part of broader security benefits.

ICON plc Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
34,685 Employees
Year Founded: 1990

What We Do

Since our foundation in Dublin, Ireland in 1990, our mission has been to help our clients to accelerate the development of drugs and devices that save lives and improve quality of life. We do this by delivering best in class information, solutions and performance, with an unyielding focus on quality at all times. We offer a full range of consulting, development and commercialisation services from a global network of offices in 53 countries. We focus our innovation on the factors that are critical to our clients – reducing time to market, reducing cost, and increasing quality – and our global team of experts has extensive experience in a broad range of therapeutic areas.

Similar Jobs

Genius Sports Logo Genius Sports

Sports Data Operator (Civil contract)

AdTech • Artificial Intelligence • Machine Learning • Marketing Tech • Software • Sports • Big Data Analytics
Easy Apply
Remote or Hybrid
Bulgaria
1800 Employees

DraftKings Logo DraftKings

Senior Lead Technical Operations Engineer

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
Sofia, Sofia-grad, BGR
6400 Employees

Mondelēz International Logo Mondelēz International

Manager, Project & Program Mgt, Project Management

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
6 Locations
90000 Employees

Tufin Logo Tufin

Consultant

Security • Cybersecurity
Remote or Hybrid
27 Locations
500 Employees

Similar Companies Hiring

Fortune Brands Innovations Thumbnail
Manufacturing
Deerfield, IL
10000 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account