Senior QA / Test Engineer - AI & Platform

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office
Senior level
Cloud • Digital Media • Information Technology • Software
The Role
Lead QA and production-readiness activities for an AI-enabled digital platform. Define and execute functional, integration, regression, end-to-end, API, and workflow testing; maintain automated test coverage; support UAT, defect management, releases, and go-live decisions. Evaluate AI-generated outputs and RAG retrieval quality for accuracy, relevance, grounding, consistency, and hallucinations. Collaborate with engineering, product, and operations teams to investigate and resolve defects.
Summary Generated by Built In

UBDS is looking for an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform.

You will define and execute test strategies across application functionality, workflows and integrations, working closely with engineering, product and operational teams throughout the development lifecycle. The role combines traditional software testing with the evaluation of AI and retrieval-based functionality.

Due to the nature of the programme, candidates must hold current SC Clearance.

What you'll be doing
  • Define and execute test strategies covering functional, integration, regression and end-to-end testing.
  • Develop and maintain automated test coverage across applications, APIs and workflows.
  • Support UAT, defect management, release testing and production readiness.
  • Test APIs and integrations across internal and external services.
  • Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
  • Assess RAG and retrieval performance, ensuring relevant information is retrieved and used appropriately.
  • Establish repeatable evaluation approaches and datasets for AI-enabled functionality.
  • Work with engineering teams to investigate, reproduce and resolve defects.
  • Provide clear quality evidence to support release and go-live decisions.
What we're looking for
  • Strong experience in QA, Test Engineering or Test Automation within production applications.
  • Experience with test automation frameworks such as Playwright, Cypress or Selenium.
  • Strong API and integration testing skills using tools such as Postman.
  • Experience with SQL, CI/CD and defect management tooling such as Jira or Azure DevOps.
  • Good technical understanding of web applications, APIs and modern application architectures.
  • Experience testing Generative AI, LLM or RAG solutions would be highly desirable.
  • Understanding of AI evaluation concepts including groundedness, relevance, hallucination testing and retrieval quality.
  • Python, TypeScript/JavaScript or similar scripting experience would be advantageous.
  • Strong analytical, problem-solving and stakeholder communication skills.

Benefits

Why people choose to grow their careers at UBDS Group

 Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

 UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

  • Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
  • Private medical cover for you and your spouse/partner, offered via Vitality
  • Discretionary bonus based on a blend of personal and company performance
  • Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
  • Electric Vehicle leasing with salary sacrifice
  • Contributed Pension Scheme
  • Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.

Skills Required

  • Strong experience in QA, test engineering, or test automation within production applications
  • Experience with Playwright, Cypress, or Selenium
  • Strong API and integration testing skills using tools such as Postman
  • Experience with SQL, CI/CD, and defect management tools such as Jira or Azure DevOps
  • Technical understanding of web applications, APIs, and modern application architectures
  • Strong analytical, problem-solving, and stakeholder communication skills
  • Current SC Clearance
  • Experience testing Generative AI, LLM, or RAG solutions
  • Understanding of AI evaluation concepts including groundedness, relevance, hallucination testing, and retrieval quality
  • Python, TypeScript, JavaScript, or similar scripting experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
120 Employees
Year Founded: 2000

What We Do

UBDS Digital, a brand on a mission to deliver unparalleled client value, unmatched employee experience, and to make a meaningful difference in society. We understand your needs deeply and are laser focused on outcomes, never compromising on quality or security. We are your visionary partner, taking on complex work, creating smarter solutions, with innovative technologies, for the best results and producing lasting progress, for all. In September 2024, UBDS Digital became B Corp Certified. This certification affirms our commitment to purpose-driven practices and using business as a force for positive change. We are proud to align each project with the broader mission of benefiting all stakeholders, not just shareholders, and to be part of a movement of forward-thinking companies that prioritise societal impact.

Similar Jobs

NBCUniversal Logo NBCUniversal

Manager EHS, International

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Hybrid
London, Greater London, England, GBR

NBCUniversal Logo NBCUniversal

PA to MD & Marketing Director (FTC)

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Hybrid
London, Greater London, England, GBR

NBCUniversal Logo NBCUniversal

Manager, Emergency Management Services

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Hybrid
Bedford, Bedfordshire, England, GBR

NBCUniversal Logo NBCUniversal

Advisor EHS, International

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Hybrid
London, Greater London, England, GBR

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account