The Role
Join the CrowdGen team as an Independent Contractor for Project Babel. We are seeking detail-oriented and skilled annotators to support the evaluation and improvement of multilingual prompt-response data used in the training and assessment of large language models (LLMs). Your role will directly contribute to ensuring translations are accurate, contextually appropriate, and aligned with AI safety and ethical standards.
Key Responsibilities:
- Evaluate Translations: Review English prompts and responses alongside their translated counterparts. Assess quality across multiple linguistic and contextual dimensions.
- Rate Quality: Use structured criteria (fluency, grammar, translation accuracy, relevance, and correctness) to score prompt and response translations.
- Apply Judgement: Identify issues in translations and suggest post-edits when ratings fall below threshold (≤2), ensuring that corrections maintain the original meaning, fluency, and cultural appropriateness.
- Adhere to Evaluation Protocol: Follow defined annotation guidelines and metric definitions. Ensure all work aligns with project standards for linguistic quality and AI safety goals.
- Collaborative Accuracy: Work individually or as part of a group of annotators (three per task for Priority 0 languages; one for others). Engage with adjudication rules (majority consensus or flagging) to resolve rating discrepancies.
- Structured Submission: Complete annotations using a provided CSV template, ensuring all required fields are accurately filled.
Qualifications:
- Language Proficiency: Native or near-native fluency in both English and Chinese.
- Language Aware: Strong understanding of grammar, syntax, and cultural nuance in both source and target languages.
- Attention to Detail: Ability to follow complex guidelines and apply consistent evaluation standards.
Experience:
- Prior work in translation, linguistic annotation, localization QA, or similar roles is highly desirable.
- Comfortable working with structured file formats (e.g., CSV), spreadsheets, and task management tools.
- Background in linguistics, computational linguistics, translation studies, or a related field highly desired.
- Familiarity with multilingual NLP tasks or LLMs.
- Ability to work independently and meet deadlines reliably.
This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role.
Why This Work Matters:
High-quality annotations are essential to building safer, more natural, and more inclusive AI systems. Your work ensures that multilingual outputs retain meaning, accuracy, and relevance across languages and cultural contexts—directly shaping how language models interact with a global user base.
Similar Jobs
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
We help our clients enhance their best-in-class products and services around the world, including search engines, social media platforms, voice recognition systems, sentiment analysis, and eCommerce sites. All of that wouldn’t be possible without our team of more than 1 million flexible workers. The world of tech is moving fast, and we help our clients meet the ever-changing needs of their customers. We take pride in our diverse, international team and the flexible and full-time opportunities we offer.
