The Role
Review and label English-language content for sentiment, factual accuracy, and reasoning. Evaluate model outputs using scoring frameworks, validate automated assessments, and identify discrepancies or errors, applying consistent annotation standards and written justifications.
Summary Generated by Built In
Contract Type: Freelance
Language: English (Philippines)
About the Role
We are seeking a detail-oriented AI Data Quality & Annotation Specialist to help develop and evaluate large language models (LLMs). Your role will involve reviewing English language content to assess sentiment accuracy, factual consistency, and reasoning quality using structured guidelines. This position is ideal for individuals with sharp analytical skills, attention to detail, and the ability to consistently apply labeling standards.
What You Will Do:
- Review and label content for sentiment, factual accuracy, and reasoning issues.
- Evaluate model outputs across quality dimensions using scoring frameworks.
- Validate automated assessments and identify discrepancies or errors.
Requirements:
- Advanced English proficiency (reading and writing) with professional-level fluency.
- Strong comprehension and articulation skills, with the ability to provide clear and well-reasoned written justifications.
- Previous experience in data annotation, AI training, or related projects.
- Preferred experience in analytical fields such as linguistics, journalism, research, or similar domains.
- Exceptional attention to detail and accuracy.
- Proven analytical reasoning and critical thinking abilities.
- Consistency in decision-making across high volumes of tasks.
- Familiarity with AI systems, large language models (LLMs), or evaluation processes (preferred but not required).
Skills Required
- Advanced English proficiency (reading and writing) with professional-level fluency
- Strong comprehension and articulation skills; ability to provide clear, well-reasoned written justifications
- Previous experience in data annotation, AI training, or related projects
- Preferred experience in analytical fields such as linguistics, journalism, or research
- Exceptional attention to detail and accuracy
- Proven analytical reasoning and critical thinking abilities
- Consistency in decision-making across high volumes of tasks
- Familiarity with AI systems, large language models (LLMs), or evaluation processes
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
