Quality Analyst — Generative AI Data Quality

Posted 9 Days Ago
Hyderabad, Telangana, IND
Hybrid
Junior
Artificial Intelligence • Machine Learning • Natural Language Processing • Professional Services
The Role
Own client-specific QA programs for generative AI data: set QA strategies, run root-cause analyses, drive CAPA, plan rater training/certification, maintain dashboards, manage escalations, standardize SOPs, pilot automations, coach teams, and ensure data handling compliance across distributed projects.
Summary Generated by Built In

About Welo Data

Welo Data, a Welo Global brand, is the multilingual data and evaluation partner for foundation labs and enterprises deploying GenAI systems globally. They deliver the human judgment, data infrastructure, and evaluation systems that ensure AI models perform reliably across languages, cultures, and real-world contexts, at every stage from training through deployment.  Its global network of 500,000+ vetted experts spans 300+ languages and locales, enabling high-quality multilingual data creation and structured model evaluation across the full spectrum of modern AI applications — from large language models and voice and speech systems to agentic workflows and robotics and embodied AI. This breadth of linguistic, cultural, and domain expertise enables Welo Data to address critical AI development challenges, including safety, bias, inclusivity, and cross-lingual reliability. A unified global operating model, led by specialized program and quality experts and grounded in assessment-driven talent selection, localized rubrics, and continuous calibration, ensures consistent performance across languages, domains, and modalities. Underpinning all of this is NIMO™ (Network Identity Management and Operations), Welo Data's proprietary identity and fraud-prevention framework. Built to maintain data integrity and workforce trust across a global contributor base, NIMO combines advanced verification, continuous monitoring, and structured QA to ensure every dataset is accurate, traceable, and culturally grounded. welodata.ai   


Role Purpose
Owns client-specific quality programs, performance metrics, and escalations while leading team development and cross-functional coordination. Shared accountability for client outcomes and team performance with the Ops Manager
 
Key Responsibilities
·       Set client QA strategies (sampling design, audit methods, acceptance thresholds) and adapt to scope/volume changes.
·       Run root-cause analyses; drive CAPA plans with owners, timelines, and effectiveness checks.
·       Plan training & certification for raters/annotators and coordinators; track completion and impact.
·       Maintain dashboards (throughput, accuracy, productivity, cost) and convert insights into actions.
·       Manage client escalations; present options, trade-offs, and recovery paths.
·       Standardize SOPs, templates, and checklists; remove bottlenecks.
·       Pilot small automations (macros, templates, RPA/API handoffs) with Ops Tech; scale wins.
·       Coach P1s and C2–C3 on tools, workflows, and QA craft.
·       Ensure compliance/security across data handling and platform access.
 
Requirements
Education
·       Bachelor’s degree or equivalent experience in Business, Operations, Quality, or Data/Engineering.
Experience
·       2+ years in quality/ops with hands-on QA and workforce/training coordination.
·       1+ years leading people/pods (formal or informal).
Skills
·       Multi-project planning and stakeholder management.
·       Clear client communications and governance cadence participation.
·       Strong spreadsheets, PM/task boards, and basic BI; ETL familiarity is a plus.
·       Capacity planning with vendors; confident escalation/negotiation.
·       Effective in global, distributed teams.
 
Additional Qualifications
·       Near-native English with strong writing and editorial skills.
·       Hands-on with generative AI tools (text/voice/video).
·       Background in QA testing, rubric design, or AI safety/ethics evaluation.
·       Familiarity with data-annotation platforms and model-evaluation tools.
·       Ability to interpret code/datasets/workflows at a conceptual level (no coding required).
·       Works independently and manages workflows effectively in a remote setup.
·       Multilingual ability beyond English.
 
Scope & Autonomy
·       Leads quality, training, and performance tracks across several projects; independent within guardrails.
·       Shared accountability for client results and team performance with Ops Manager.
 
Job Reference: #LI-JC1

Skills Required

  • Bachelor's degree or equivalent experience in Business, Operations, Quality, or Data/Engineering
  • 2+ years in quality/operations with hands-on QA and workforce/training coordination
  • 1+ years leading people/pods (formal or informal)
  • Multi-project planning and stakeholder management
  • Clear client communications and participation in governance cadence
  • Strong spreadsheets
  • Experience with PM/task boards
  • Basic BI skills
  • ETL familiarity
  • Capacity planning with vendors; confident escalation and negotiation
  • Effective working in global, distributed teams
  • Near-native English with strong writing and editorial skills
  • Hands-on experience with generative AI tools (text/voice/video)
  • Background in QA testing, rubric design, or AI safety/ethics evaluation
  • Familiarity with data-annotation platforms and model-evaluation tools
  • Ability to interpret code, datasets, and workflows at a conceptual level (no coding required)
  • Works independently and manages workflows effectively in a remote setup
  • Multilingual ability beyond English
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6,543 Employees

Similar Jobs

Micron Technology Logo Micron Technology

Staff Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Micron Technology Logo Micron Technology

Senior Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Micron Technology Logo Micron Technology

Senior Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Micron Technology Logo Micron Technology

Designer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Similar Companies Hiring

Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account