Gen AI Tester

Reposted 11 Days Ago
Be an Early Applicant
Hiring Remotely in Hyderabad, Telangana
In-Office or Remote
Senior level
Artificial Intelligence • Information Technology
The Role
The Generative AI Tester will validate AI-driven features, ensure model reliability, and drive end-to-end testing workflows in enterprise applications.
Summary Generated by Built In
Description

About us:

Where elite tech talent meets world-class opportunities!

At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today’s most complex challenges.

We are building a community of top-tier experts and we’re opening the doors to an exclusive group of exceptional AI & ML Professionals ready to solve real-world problems and shape the future of intelligent systems.


Requirements

Job Description – Generative AI Tester (5+ Years Experience)

Role Overview

We are seeking a skilled and proactive Generative AI Tester with over 5 years of experience in software testing and quality assurance, including 2–3 years focused on Generative AI systems. The ideal candidate will be responsible for validating AI-driven features, ensuring model reliability, and driving end-to-end testing workflows across enterprise-grade applications.

Key Responsibilities

  • Collaborate with product, data science, and engineering teams to understand AI use cases and define test strategies.
  • Design and execute test cases for LLM-based features such as summarization, classification, conversational flows, and content generation.
  • Validate model outputs for factual accuracy, tone, relevance, and compliance with domain-specific standards.
  • Develop automated test scripts and frameworks for prompt-response validation and regression testing.
  • Evaluate ML models using metrics like precision, recall, F1-score, and domain-specific thresholds.
  • Conduct integration testing across cloud platforms (e.g., AWS, Azure, GCP) and data environments (e.g., Snowflake, Databricks).
  • Document test results, anomalies, and improvement suggestions in structured formats.
  • Ensure ethical AI practices and compliance with data governance policies.

Required Skills & Experience

  • 5+ years in software testing, QA, or data validation roles.
  • 2–3 years hands-on experience testing Generative AI models (e.g., GPT, LLaMA, Claude).
  • Strong proficiency in Python and experience with ML testing tools or frameworks.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and data engineering environments (Snowflake, Databricks).
  • Understanding of ML workflows including time series, regression, classification, and neural networks.
  • Excellent communication skills and ability to drive cross-functional discussions with ownership.

Preferred Qualifications

  • Exposure to domain-specific AI applications (e.g., pharma, healthcare, finance).
  • Experience with prompt engineering and LLM evaluation frameworks.
  • Knowledge of ethical AI principles and regulatory compliance (e.g., HIPAA, GDPR).

Top Skills

AWS
Azure
Databricks
GCP
Python
Snowflake
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
11 Employees

What We Do

Xenon7 delivers specialized AI operations, AI products and services. Our innovation practice helps you separate initiatives warranting business investment from hype. We operate free from the bloat, weight and pyramidal structure of legacy consulting firms. Xenon7 enables our clients to make better human and technology decisions, and ethically achieve more with less

Similar Jobs

QuillBot Logo QuillBot

Data Scientist

Artificial Intelligence • Edtech • Mobile • Natural Language Processing • Productivity • Software
Easy Apply
Remote
India
232 Employees

ServiceNow Logo ServiceNow

Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Hyderabad, Telangana, IND
28000 Employees

ServiceNow Logo ServiceNow

Servicenow Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Hyderabad, Telangana, IND
28000 Employees

Cloudflare Logo Cloudflare

Solutions Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
India
4400 Employees

Similar Companies Hiring

Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account