The Role
Oversee AI training data programs, manage project delivery, vendor management, process automation, quality assurance, and client communication.
Summary Generated by Built In
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Role Purpose:
Oversees multi-project portfolios for AI training data programs. Leads delivery and scale: capacity planning, vendor management, and process automation. Ensures quality is consistent across projects, drives performance improvements, and plans work jointly with the Sr. Quality Analyst. Oversees a portfolio of programs that deliver and scale Generative AI data operations, including capacity planning, vendor management, and process automation.
Key Responsibilities
- Portfolio delivery: Plan and run a group of projects (collection, labeling, evaluation) end-to-end; set priorities, milestones, and handoffs across time zones.
- Governance & reporting: Run cadence (status, risk, exec updates); align scope and budget with account and operations leads.
- Capacity planning: Forecast and secure rater/annotator capacity; balance shifts, throughput, and skills across vendors and internal teams.
- Quality consistency: Partner with the Sr. Quality Analyst on acceptance criteria, audits, and corrective actions; keep guidelines aligned across projects.
- Process automation & tooling: Identify manual steps; pilot automation with Ops Tech (templates, scripts, RPA, API-driven flows); scale what works.
- Vendor management: Set expectations, SLAs, and playbooks; review performance and drive improvements or changes as needed.
- Financial control: Build and track budgets, burn, and margins; manage change orders to protect financial outcomes.
- Risk, issue & change: Lead root-cause and action plans; escalate high-impact items with options and impact.
- Client and stakeholder management: Lead planning and QBR-style reviews; explain results, risks, and next steps in clear terms.
- Team enablement: Coach PMs and Coordinators on planning, QA, and tools; support onboarding and skills growth (no formal line management required).
- Compliance & security: Ensure data handling, privacy, and access controls are followed across all workstreams.
Skills
- Portfolio planning and governance across several projects at once.
- Clear communication with senior clients and internal leaders; runs planning and QBR-style reviews.
- Strong use of spreadsheets, PM/task boards, and basic BI; familiarity with SQL/ETL concepts is a plus.
- Sound judgment on scope, time, cost, and quality trade-offs.
- Negotiation and escalation to resolve risks, issues, and change.
- Coaching mindset; guides PMs and Coordinators.
- Comfortable working with global, distributed teams (intermediate to advanced English).
Additional Qualifications
- Near-native English with strong writing and editorial skills.
- Hands-on experience with generative AI tools (text, voice, or video).
- Background in QA testing, rubric design, or AI safety/ethics evaluation.
- Familiarity with data-annotation platforms and model-evaluation tools.
- Ability to interpret code, datasets, and system workflows at a conceptual level (no coding required).
- Able to work independently and manage workflows effectively in a remote environment.
- Multilingual ability beyond English.
Scope and Autonomy
- Owns outcomes for a portfolio of small/medium projects or a large multi-workstream program.
- Works independently; defines delivery approach and engages leaders for non-standard items.
- Joint planning and shared responsibility for quality and client outcomes with the Sr. Quality Analyst.
Education Requirements
- Bachelor’s degree or equivalent experience in business, operations, data/engineering, or similar experience.
- 2–3 years leading multi-project portfolios or large multi-workstream programs in AI data, content review, labeling/annotation, or related fields.
- Background in capacity planning, vendor coordination, and quality systems; experience piloting or scaling process automation is a plus.
Top Skills
Data Annotation Platforms
ETL
Generative Ai Tools
Model Evaluation Tools
SQL
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 250,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our people work across offices in North America, Europe, and Asia serving our global clients in the markets that matter to them.
• Global team of 2,100+
• Offices in North America, Europe and Asia
• Quality Certifications: ISO 9001:2015, ISO/IEC 27001:2013, ISO 17100:2015, ISO 13485:2016, ISO 18587:2017
• Accredited professional translators and interpreters for 250+ languages
www.welocalize.com
