The Role
Manage quality assurance, workforce planning, and training for AI training data projects, improving processes and client outcomes. Responsible for performance metrics and compliance, while coaching team members and handling stakeholder support.
Summary Generated by Built In
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Summary:
Owns quality assurance, workforce planning, and training programs for AI training data delivery on multiple small projects or one large strategic project. Improves performance, compliance, and processes across multiple projects. Partners with the Senior Quality Analyst to share accountability for client outcomes and team performance. “Owns quality, workforce, and training programs that scale Generative AI data operations, driving performance, compliance, and process improvement across a project.”
This role will provide AMER timezone PM coverage to support my team, helping ensure continuity, faster turnaround, and reduced after-hours coverage gaps especially important if/when NVIDIA launches.
Key Responsibilities
- Quality Assurance: Monitor QA plans in partnership with Quality team (sampling, audits, acceptance criteria). Track risks of defects, lead corrective actions, and prevent recurrences.
- Workforce Planning: Forecast capacity needs; schedule shifts and handoffs; align vendors and internal teams to meet volume and turnaround targets.
- Training Programs: Build and deliver training and certification for raters/annotators and coordinators; update materials as guidelines change.
- Performance Management: Maintain dashboards for throughput, quality, productivity, and cost; turn data into clear actions for improvement.
- Compliance & Security: Ensure policy adherence on data handling, privacy, safety, and platform access; support audits and remediation.
- Process Improvement: Standardize SOPs and checklists; remove bottlenecks; pilot small changes that improve speed, quality, or cost.
- Stakeholder & Client Support: Join client reviews with the Quality Manager and PMs; explain quality results, risks, and next steps.
- Team Development: Coach Coordinators (C2–C3) and Associate PMs (P1) on QA, workflows, and tools; support onboarding and skills growth.
- Team Management: Manage employee attendance, conduct individual performance reviews and support contract renewals.
- Risk & Change Control: Keep risk/issue logs; manage change requests that impact quality, capacity, or training; escalate high-impact items with options.
Skills
- Planning and organization across multiple projects (quality, workforce, and training tracks).
- Clear communication with clients and internal partners; confident in reviews and governance forums.
- Solid use of spreadsheets, PM/task boards, and basic BI; familiarity with ETL concepts is a plus.
- Practical QA know-how (sampling, audits, acceptance criteria) and continuous-improvement mindset.
- Capacity planning, scheduling, and vendor coordination.
- Coaching for C2–C3 Coordinators and P1s; gives day-to-day guidance.
- Confident escalation and negotiation to resolve risks, issues, and scope questions.
- Comfortable working with global, distributed teams (intermediate to advanced English).
Additional Qualifications
- Near-native English with strong writing and editorial skills.
- Hands-on experience with generative AI tools (text, voice, or video).
- Background in QA testing, rubric design, or AI safety/ethics evaluation.
- Familiarity with data-annotation platforms and model-evaluation tools.
- Ability to interpret code, datasets, and system workflows at a conceptual level (no coding required).
- Able to work independently and manage workflows effectively in a remote environment .
- Multilingual ability beyond English.
Scope and Autonomy
- Leads quality, workforce, and training programs across multiple projects; influences delivery outcomes without formal line management.
- Works independently within scope, budget, compliance, and quality guardrails; escalates exceptions.
- Shares accountability for client results and team performance.
Education and Experience
- Bachelor’s degree or equivalent experience in business, data/operations, engineering, or related fields.
- 2+ years in project/operations delivery with hands-on QA and workforce planning (AI data, content review, labeling/annotation, or adjacent domains).
- Experience running trainings and coordinating multi-team delivery.
Top Skills
Basic Bi
Data Annotation Platforms
Generative Ai Tools
Model Evaluation Tools
Pm Task Boards
Spreadsheets
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them.
• Global team of 2,100+
• Offices in North America, Europe and Asia
• Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017
• Accredited professional translators and interpreters for 250+ languages
www.welocalize.com
