GenAI QA Architect (Adoption Leader)

Posted 3 Days Ago
Be an Early Applicant
Ukraine
Senior level
Information Technology • Consulting
The Role
Lead the integration of GenAI into QA processes by designing testing strategies, enabling teams, and refining tools for LLM outputs across multiple projects.
Summary Generated by Built In

N-iX is a global software development service company that helps businesses across the globe create next-generation software products. Founded in 2002, we unite 2,400+ tech-savvy professionals across 40+ countries, working on impactful projects for industry leaders and Fortune 500 companies. Our expertise spans cloud, data, AI/ML, embedded software, IoT, and more, driving digital transformation across finance, manufacturing, telecom, healthcare, and other industries. Join N-iX and become part of a team where your ideas make a real impact.

We’re building a small GenAI Adoption team (GenAI Value Lab) to help delivery projects use AI in real work — not in side experiments.

This role is the QA/Testing specialist: you design how GenAI fits into testing, prove it on real projects, and enable account teams to run it themselves. You don’t own their frameworks long-term — you enable, then move on to the next team.

We’re not looking for someone who “knows it all.” GenAI in QA is still new. Part of your job will be to experiment, break things (safely), learn, and share what actually works. If you’ve played with tools like Copilot, Claude, Cursor, or LLMs in platforms like LambdaTest etc for test generation/log analysis – and you’re excited to turn that into real practice for real teams – you’ll feel right at home.

If you’re a QA Architect / Senior QA who wants to practice GenAI every day, work across multiple stacks, and help hundreds of engineers upgrade how they test, this is that role.

Responsibilities: 

1. GenAI + QA workflows: 

  • Define and document testing strategies for GPT/LLM-based features (functional, non-functional, ethical).
  • Design LLM-specific test plans, cases, and data: prompt variants, hallucination detection, safety/guardrail checks, response consistency.
  • Set quality gates and acceptance criteria for LLM outputs (accuracy, safety, fairness, UX).
  • Identify and pilot AI-specific testing tools (e.g. DeepChecks, AI Fairness 360, MLflow/TFX evaluation, prompt/adversarial testing tools) and prepare them for handover to project teams.

2. Tooling, platforms & pipelines:

  • Prototype and refine utilities, prompt libraries, and test templates that plug into existing stacks (Selenium/Cypress/Playwright, API test frameworks, performance tools, CI pipelines).
  • Build a strategic view on platform vs custom: e.g. LambdaTest / HiRafie–style suites vs Cursor/Claude Code and other IDE-centric tools — and recommend integration paths per account.
  • Integrate LLM testing workflows into CI/CD with DevOps/MLOps (sanity checks, regression, evaluation runs, quality gates).
  • Validate API integrations (auth, rate limits, error handling, fallbacks, observability around LLM calls).
  • Ensure QA practices align with AI governance, data privacy, and responsible AI standards.

3. Enable, don’t own:

  • Run workshops, live demos, and pairing sessions with QA/SDET teams — learning by doing, not watching slides.
  • Help teams move from “copy-pasting prompts” to structured, documented, and safe AI usage in testing.
  • Capture results as GenAI Value Lab playbooks, templates, and case studies that can be reused across accounts.

4. Measure impact:

  • Track hard metrics: defect escape rate, regression time, flaky test rate, coverage, lead time, DORA/SPACE.
  • Track human impact: less repetitive QA work, cleaner pipelines, higher confidence before release.
  • Turn improvements into clear stories that make adoption easier for the next team.

Requirements:

  • Proven experience as QA Architect / Test Lead / Senior QA/SDET in a modern SDLC (automation + CI/CD).
  • Strong base in:
    • Test strategy & test pyramid
    • UI/API automation and CI integration
    • At least some non-functional testing (performance/reliability/security basics)
  • Hands-on with modern QA tooling: e.g. Selenium / Cypress / Playwright, REST API testing, test runners/reporting tools, CI/CD (Jenkins, GitHub Actions, GitLab, etc.).
  • Able to read and reason about test code (Java, C#, Python or similar).

GenAI understanding:

  • You’ve already used GenAI for real work: generating tests, refactoring test code, analyzing logs, writing docs, etc.
  • Understanding of LLMs, prompt engineering, and GenAI workflows (you don’t have to be a researcher, but you’re not starting from zero).
  • Experience or strong interest in:
    • Testing GPT/LLM-based features
    • Handling hallucination, bias, and safety risks
    • Designing tests for “approximate” outputs, not just exact matches
  • Skilled in or willing to learn Python/PyTest/Postman and evaluation tooling (bonus: LangChain, OpenAI APIs, model evaluation frameworks, fairness/bias tools).

How you work:

  • Comfortable leading change: introducing new tools/processes, showing value with real numbers, not buzzwords.
  • Able to tailor solutions to different client rules, compliance needs, and tech stacks.
  • Clear communicator who can talk to QA, devs, architects, and managers without turning it into a research lecture.

How GenAI Value Lab works (and why this is interesting)

  • We don’t replace project QA teams or run their regression suites forever.
  • We do:
    • Design patterns and guardrails
    • Prove them on 1–2 projects
    • Turn them into reusable playbooks and move to the next account

You’ll work across multiple accounts and domains, helping up to 1,700 engineers and dozens of QA teams change how they test — while building your own GenAI expertise much faster than staying in a single product team.

If you’re a QA architect who wants to be on the front line of how testing changes with GenAI — and you enjoy enabling many teams more than owning one codebase — we’d like to talk.

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Top Skills

Ai Fairness 360
C#
Ci/Cd
Cypress
Docker
Genai
Github Actions
Java
Jenkins
Llms
Playwright
Python
Qa
Selenium
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: North Miami Beach, Florida
2,135 Employees
Year Founded: 2002

What We Do

N-iX is a global software solutions and engineering services company that helps world’s leading organizations turn challenges into lasting business value, operational efficiency, and revenue growth using advanced technology. Whether you need to build a custom solution, modernize your digital product or acquire extra tech expertise - we have the experience and capabilities to ensure your success.

With over 2,000 professionals in 25 countries across Europe and the Americas, N-iX offers expert solutions in cloud, data analytics, embedded software, IoT, AI, machine learning, and other tech domains. Being in business for over two decades, we have worked with dozens of industry-leading enterprises and Fortune 500 companies creating value across a wide variety of sectors, including finance, manufacturing, supply chain, retail, e-commerce, healthcare, and more. Our unique combination of business domain expertise and technical know-how enables us to effectively collaborate with ISVs, tech companies, and enterprises of all sizes. Thanks to the strong tech ecosystem and partnerships with AWS, GCP, Microsoft, SAP, OpenText, Snowflake, and others, we bring extra speed, scale and efficiency to more than 160 organizations across the globe. N-iX is recognized by numerous industry awards, such as CRN Solution Provider 500, Global Outsourcing 100 by IAOP, ISG Provider Lens™, Modern Application Development services providers by Forrester, etc

Similar Jobs

LogicMonitor Logo LogicMonitor

Account Executive

Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
Easy Apply
Hybrid
28 Locations
1100 Employees

WeLocalize Logo WeLocalize

Shape the Future of AI — Norwegian Talent Hub

Machine Learning • Natural Language Processing
In-Office or Remote
34 Locations
2331 Employees
In-Office or Remote
34 Locations
2331 Employees

WeLocalize Logo WeLocalize

Shape the Future of AI — French Talent Hub

Machine Learning • Natural Language Processing
In-Office or Remote
34 Locations
2331 Employees

Similar Companies Hiring

Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account