Senior/Tech Lead QA (with AI experience)

Posted 8 Days Ago
Be an Early Applicant
Hiring Remotely in Ukraine
Remote
Senior level
Information Technology • Consulting
The Role
Lead manual QA for an AI-powered document analysis platform. Test CMS and backend functionality, REST APIs, web UIs, and AI/ML outputs. Develop test cases, plans, and bug reports; validate RAG and LLM responses for accuracy, consistency, hallucinations, and context relevance. Participate in requirements reviews, collaborate with AI and engineering teams, and build reusable QA assets and processes within an Agile/Scrum environment.
Summary Generated by Built In

We're looking for a hands-on Senior/Lead Manual QA Engineer who can cover the full testing spectrum: UI, API, and AI/ML output validation. You'll be joining a project building an AI-powered document analysis platform from the ground up. The system combines a CMS backend, modern UI, and a RAG-based AI layer used for intelligent document processing and analysis.

Key Responsibilities

  • Follow a phased QA approach - begin with CMS and backend testing to establish a reliable baseline of expected system behavior, then apply those insights to validate AI agent outputs effectively
  • Design and execute test cases for REST APIs, covering functional correctness, edge cases, error handling, authentication, and data integrity
  • Perform UI testing across core user journeys, validating layout, behavior, and integration with backend services
  • Transition into AI output validation once the deterministic layers are stable - using your knowledge of business rules to identify inconsistencies, hallucinations, or degraded outputs in agent responses
  • Document and maintain test cases, test plans, and bug reports in a structured and traceable way
  • Participate in requirement reviews and technical discussions to identify testability gaps early
  • Collaborate with the Lead Big Data/AI Engineer and AI team to understand RAG pipeline behavior, document ingestion flows, and output quality expectations
  • Contribute to building reusable test assets and QA processes as the project scales

Requirements

  • 4+ years of experience in manual QA, with exposure to frontend, backend and AI testing
  • Solid experience with API testing using tools such as Postman, REST Client, or similar
  • Experience testing web UIs and understanding of cross-browser/cross-environment considerations
  • Ability to read and interpret API documentation, data schemas, and system architecture descriptions
  • Hands-on experience working on projects that included AI, ML, or NLP components — particularly validating outputs that are probabilistic or context-dependent
  • Experience with the concept of RAG (Retrieval-Augmented Generation) or LLM-based systems
  • Strong analytical thinking — especially the ability to assess whether an AI response is contextually correct, not just technically non-null
  • Good understanding of test documentation practices: test plans, test cases, bug reports, traceability
  • Experience working in Agile/Scrum teams
  • Upper-Intermediate English or higher - you'll be communicating directly with the client and cross-functional team members
  • Familiarity with Palantir Foundry is a strong plus

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Skills Required

  • 4+ years of manual QA experience
  • Experience testing frontend, backend, and AI systems
  • API testing experience with Postman, REST Client, or similar tools
  • Web UI testing experience, including cross-browser and cross-environment considerations
  • Ability to interpret API documentation, data schemas, and system architecture descriptions
  • Hands-on experience testing AI, ML, or NLP components
  • Experience validating probabilistic or context-dependent AI outputs
  • Familiarity with RAG or LLM-based systems
  • Strong analytical ability to assess contextual correctness of AI responses
  • Understanding of test plans, test cases, bug reports, and traceability
  • Experience working in Agile or Scrum teams
  • Upper-Intermediate English or higher
  • Familiarity with Palantir Foundry
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Valletta
2,135 Employees
Year Founded: 2002

What We Do

N-iX is a global software solutions and engineering services company that helps world’s leading organizations turn challenges into lasting business value, operational efficiency, and revenue growth using advanced technology. Whether you need to build a custom solution, modernize your digital product or acquire extra tech expertise - we have the experience and capabilities to ensure your success. With over 2,000 professionals in 25 countries across Europe and the Americas, N-iX offers expert solutions in cloud, data analytics, embedded software, IoT, AI, machine learning, and other tech domains. Being in business for over two decades, we have worked with dozens of industry-leading enterprises and Fortune 500 companies creating value across a wide variety of sectors, including finance, manufacturing, supply chain, retail, e-commerce, healthcare, and more. Our unique combination of business domain expertise and technical know-how enables us to effectively collaborate with ISVs, tech companies, and enterprises of all sizes. Thanks to the strong tech ecosystem and partnerships with AWS, GCP, Microsoft, SAP, OpenText, Snowflake, and others, we bring extra speed, scale and efficiency to more than 160 organizations across the globe. N-iX is recognized by numerous industry awards, such as CRN Solution Provider 500, Global Outsourcing 100 by IAOP, ISG Provider Lens™, Modern Application Development services providers by Forrester, etc

Similar Jobs

Pfizer Logo Pfizer

Director, AI Product Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Associate, AI Engineering

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Global Head, Site Contracting

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
30 Locations
121990 Employees
215K-358K Annually

Pfizer Logo Pfizer

Director, AI Applications Engineering Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account