Quality Analyst - Generative AI Data

Posted 12 Days Ago
Be an Early Applicant
Hiring Remotely in México
Remote
Junior
Machine Learning • Natural Language Processing
The Role
Lead and own client-specific QA programs for generative AI data: set QA strategies, run root-cause analyses and CAPA, plan rater training and certification, maintain dashboards, manage escalations, standardize SOPs, pilot automations, coach raters, and ensure secure data handling across distributed teams.
Summary Generated by Built In

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank you!

NOTICE:  For Privacy Policy please review here

Job Responsibilities:

Owns client-specific quality programs, performance metrics, and escalations while leading team development and cross-functional coordination. Shared accountability for client outcomes and team performance with the Ops Manager.

Key Responsibilities 

  • Set client QA strategies (sampling design, audit methods, acceptance thresholds) and adapt to scope/volume changes. 

  • Run root-cause analyses; drive CAPA plans with owners, timelines, and effectiveness checks. 

  • Plan training & certification for raters/annotators and coordinators; track completion and impact. 

  • Maintain dashboards (throughput, accuracy, productivity, cost) and convert insights into actions. 

  • Manage client escalations; present options, trade-offs, and recovery paths. 

  • Standardize SOPs, templates, and checklists; remove bottlenecks. 

  • Pilot small automations (macros, templates, RPA/API handoffs) with Ops Tech; scale wins. 

  • Coach P1s and C2–C3 on tools, workflows, and QA craft. 

  • Ensure compliance/security across data handling and platform access. 

Additional Job Details:

Education 

  • Bachelor’s degree or equivalent experience in Business, Operations, Quality, or Data/Engineering. 

Experience 

  • 2+ years in quality/ops with hands-on QA and workforce/training coordination. 

  • 1+ years leading people/pods (formal or informal). 

Skills 

  • Multi-project planning and stakeholder management. 

  • Clear client communications and governance cadence participation. 

  • Strong spreadsheets, PM/task boards, and basic BI; ETL familiarity is a plus. 

  • Capacity planning with vendors; confident escalation/negotiation. 

  • Effective in global, distributed teams. 

Additional Qualifications (P1+) 

  • Near-native English with strong writing and editorial skills. 

  • Hands-on with generative AI tools (text/voice/video). 

  • Background in QA testing, rubric design, or AI safety/ethics evaluation. 

  • Familiarity with data-annotation platforms and model-evaluation tools. 

  • Ability to interpret code/datasets/workflows at a conceptual level (no coding required). 

  • Works independently and manages workflows effectively in a remote setup. 

  • Multilingual ability beyond English. 

Scope & Autonomy 

  • Leads quality, training, and performance tracks across several projects; independent within guardrails. 

  • Shared accountability for client results and team performance with Ops Manager. 

Skills Required

  • Bachelor's degree or equivalent experience in Business, Operations, Quality, or Data/Engineering
  • 2+ years in quality/operations with hands-on QA and workforce/training coordination
  • 1+ years leading people/pods (formal or informal)
  • Multi-project planning and stakeholder management
  • Clear client communications and governance cadence participation
  • Strong spreadsheets skills and experience with PM/task boards and basic BI
  • Capacity planning with vendors and confident escalation/negotiation
  • Effective working in global, distributed teams and ability to work independently in a remote setup
  • Ensure compliance and security across data handling and platform access
  • Hands-on experience with generative AI tools (text/voice/video)
  • Background in QA testing, rubric design, or AI safety/ethics evaluation
  • Familiarity with data-annotation platforms and model-evaluation tools
  • ETL familiarity
  • Ability to interpret code, datasets, and workflows at a conceptual level (no coding required)
  • Near-native English with strong writing and editorial skills
  • Multilingual ability beyond English
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
2,331 Employees
Year Founded: 1997

What We Do

Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them. • Global team of 2,100+ • Offices in North America, Europe and Asia • Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017 • Accredited professional translators and interpreters for 250+ languages www.welocalize.com

Similar Jobs

Magna International Logo Magna International

Coordinador de Embarques

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
COA, Coahuila De Zaragoza, MEX
171000 Employees

Magna International Logo Magna International

Ingeniero de Calidad

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
COA, Coahuila De Zaragoza, MEX
171000 Employees

Magna International Logo Magna International

Planeador de Aceros y Aluminios

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
COA, Coahuila De Zaragoza, MEX
171000 Employees

UL Solutions Logo UL Solutions

Engineer - Electromagnetic Compatibility

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Remote or Hybrid
México
15000 Employees

Similar Companies Hiring

Allen Control Systems Thumbnail
Artificial Intelligence • Computer Vision • Machine Learning • Robotics • Defense • Manufacturing
Austin , TX
350 Employees
Blissway Thumbnail
Computer Vision • Fintech • Hardware • Internet of Things • Machine Learning • Software • Transportation
Denver, CO
24 Employees
Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account