Gen AI Tester

Reposted 2 Days Ago
Be an Early Applicant
Hiring Remotely in Hyderabad, Telangana
In-Office or Remote
Senior level
Artificial Intelligence • Information Technology
The Role
The Generative AI Tester will validate AI-driven features, ensure model reliability, and drive end-to-end testing workflows in enterprise applications.
Summary Generated by Built In
Description

About us:

Where elite tech talent meets world-class opportunities!

At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today’s most complex challenges.

We are building a community of top-tier experts and we’re opening the doors to an exclusive group of exceptional AI & ML Professionals ready to solve real-world problems and shape the future of intelligent systems.


Requirements

Job Description – Generative AI Tester (5+ Years Experience)

Role Overview

We are seeking a skilled and proactive Generative AI Tester with over 5 years of experience in software testing and quality assurance, including 2–3 years focused on Generative AI systems. The ideal candidate will be responsible for validating AI-driven features, ensuring model reliability, and driving end-to-end testing workflows across enterprise-grade applications.

Key Responsibilities

  • Collaborate with product, data science, and engineering teams to understand AI use cases and define test strategies.
  • Design and execute test cases for LLM-based features such as summarization, classification, conversational flows, and content generation.
  • Validate model outputs for factual accuracy, tone, relevance, and compliance with domain-specific standards.
  • Develop automated test scripts and frameworks for prompt-response validation and regression testing.
  • Evaluate ML models using metrics like precision, recall, F1-score, and domain-specific thresholds.
  • Conduct integration testing across cloud platforms (e.g., AWS, Azure, GCP) and data environments (e.g., Snowflake, Databricks).
  • Document test results, anomalies, and improvement suggestions in structured formats.
  • Ensure ethical AI practices and compliance with data governance policies.

Required Skills & Experience

  • 5+ years in software testing, QA, or data validation roles.
  • 2–3 years hands-on experience testing Generative AI models (e.g., GPT, LLaMA, Claude).
  • Strong proficiency in Python and experience with ML testing tools or frameworks.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and data engineering environments (Snowflake, Databricks).
  • Understanding of ML workflows including time series, regression, classification, and neural networks.
  • Excellent communication skills and ability to drive cross-functional discussions with ownership.

Preferred Qualifications

  • Exposure to domain-specific AI applications (e.g., pharma, healthcare, finance).
  • Experience with prompt engineering and LLM evaluation frameworks.
  • Knowledge of ethical AI principles and regulatory compliance (e.g., HIPAA, GDPR).

Top Skills

AWS
Azure
Databricks
GCP
Python
Snowflake
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
11 Employees

What We Do

Xenon7 delivers specialized AI operations, AI products and services. Our innovation practice helps you separate initiatives warranting business investment from hype. We operate free from the bloat, weight and pyramidal structure of legacy consulting firms. Xenon7 enables our clients to make better human and technology decisions, and ethically achieve more with less

Similar Jobs

Capco Logo Capco

BA/PO- Credit Analysis

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Capco Logo Capco

Senior Business Consulting - Programme Change Manager - GDPR -

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Boomi Logo Boomi

Engineering Manager

Cloud • Information Technology • Productivity • Software • Automation
Remote
India
2200 Employees

MetLife Logo MetLife

Team Leader - Operations

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
India
43000 Employees

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account