Senior/Tech Lead QA with AQA and AI experience

Posted 3 Days Ago
Be an Early Applicant
Hiring Remotely in Ukraine
Remote
Senior level
Information Technology • Consulting
The Role
Lead hands-on quality assurance for an AI-powered document analysis platform. Test CMS and backend functionality, REST APIs, web interfaces, and AI/ML outputs. Create and maintain test plans, cases, and defect reports; identify automation opportunities; assess RAG responses for hallucinations and contextual accuracy; review requirements; and collaborate with AI and engineering teams in an Agile environment.
Summary Generated by Built In

N-iX is looking for a Senior/Tech Lead QA Engineer with AI experience to join our team.

We're looking for a hands-on  Senior/Tech Lead QA Engineer who can cover the full testing spectrum: UI, API, and AI/ML output validation. You'll be joining a project building an AI-powered document analysis platform from the ground up. The system combines a CMS backend, modern UI, and a RAG-based AI layer used for intelligent document processing and analysis.

Responsibilities:

  • Design and execute test cases for REST APIs, covering functional correctness, edge cases, error handling, authentication, and data integrity
  • Follow a phased QA approach — begin with CMS and backend testing to establish a reliable baseline of expected system behavior, then apply those insights to validate AI agent outputs effectively
  • Perform UI testing across core user journeys, validating layout, behavior, and integration with backend services
  • Transition into AI output validation once the deterministic layers are stable — using your knowledge of business rules to identify inconsistencies, hallucinations, or degraded outputs in agent responses
  • Document and maintain test cases, test plans, and bug reports in a structured and traceable way
  • Participate in requirement reviews and technical discussions to identify testability gaps early
  • Collaborate with the Lead Big Data/AI Engineer and AI team to understand RAG pipeline behavior, document ingestion flows, and output quality expectations
  • Contribute to building reusable test assets and QA processes as the project scales

Requirements:

  • 4+ years of experience in manual QA, with exposure to frontend, backend, and AI testing
  • Solid experience with API testing using tools such as Postman, REST Client, or similar
  • Hands-on experience with test automation for web applications and/or APIs using tools or frameworks such as Playwright, Cypress, Selenium, pytest, or similar.
  • Ability to determine which test scenarios are suitable for automation versus manual validation.
  • Experience testing web UIs and understanding of cross-browser/cross-environment considerations
  • Ability to read and interpret API documentation, data schemas, and system architecture descriptions
  • Hands-on experience working on projects that included AI, ML, or NLP components — particularly validating outputs that are probabilistic or context-dependent
  • Familiarity with the concept of RAG (Retrieval-Augmented Generation) or LLM-based systems
  • Strong analytical thinking — especially the ability to assess whether an AI response is contextually correct, not just technically non-null
  • Good understanding of test documentation practices: test plans, test cases, bug reports, traceability
  • Experience working in Agile/Scrum teams
  • Upper-Intermediate English or higher — you'll be communicating directly with the client and cross-functional team members
  • Familiarity with Palantir Foundry is a strong plus

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Skills Required

  • 4+ years of manual QA experience
  • Experience testing frontend, backend, and AI systems
  • Solid API testing experience using Postman, REST Client, or similar tools
  • Hands-on web or API test automation experience using Playwright, Cypress, Selenium, pytest, or similar
  • Ability to determine which scenarios are suitable for automation versus manual validation
  • Web UI testing experience and understanding of cross-browser and cross-environment considerations
  • Ability to interpret API documentation, data schemas, and system architecture descriptions
  • Experience testing AI, ML, or NLP components, including probabilistic or context-dependent outputs
  • Familiarity with RAG or LLM-based systems
  • Strong analytical thinking for assessing contextual correctness of AI responses
  • Understanding of test plans, test cases, bug reports, and traceability
  • Experience working in Agile/Scrum teams
  • Upper-Intermediate English or higher
  • Familiarity with Palantir Foundry
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Valletta
2,135 Employees
Year Founded: 2002

What We Do

N-iX is a global software solutions and engineering services company that helps world’s leading organizations turn challenges into lasting business value, operational efficiency, and revenue growth using advanced technology. Whether you need to build a custom solution, modernize your digital product or acquire extra tech expertise - we have the experience and capabilities to ensure your success. With over 2,000 professionals in 25 countries across Europe and the Americas, N-iX offers expert solutions in cloud, data analytics, embedded software, IoT, AI, machine learning, and other tech domains. Being in business for over two decades, we have worked with dozens of industry-leading enterprises and Fortune 500 companies creating value across a wide variety of sectors, including finance, manufacturing, supply chain, retail, e-commerce, healthcare, and more. Our unique combination of business domain expertise and technical know-how enables us to effectively collaborate with ISVs, tech companies, and enterprises of all sizes. Thanks to the strong tech ecosystem and partnerships with AWS, GCP, Microsoft, SAP, OpenText, Snowflake, and others, we bring extra speed, scale and efficiency to more than 160 organizations across the globe. N-iX is recognized by numerous industry awards, such as CRN Solution Provider 500, Global Outsourcing 100 by IAOP, ISG Provider Lens™, Modern Application Development services providers by Forrester, etc

Similar Jobs

Pfizer Logo Pfizer

Director R&D EHS Program Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
36 Locations
121990 Employees
177K-294K Annually

Mondelēz International Logo Mondelēz International

o9 Change Readiness Lead

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
11 Locations
90000 Employees

Pfizer Logo Pfizer

Quality Assurance Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Manager Archiving and Compliance

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account