AI Evaluator

Posted 2 Days Ago
6 Locations
Remote
50-90 Hourly
Entry level
Artificial Intelligence • Information Technology • Professional Services • Consulting
The Role
Evaluate and annotate data and AI-generated content across varied topics. Review outputs for accuracy, relevance, clarity, reasoning quality, and completeness; identify factual or logical issues; provide structured written feedback; follow detailed evaluation guidelines; participate in quality assurance; and communicate findings clearly while maintaining strong attention to detail.
Summary Generated by Built In

About Us

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for strong generalists with excellent critical-thinking and communication skills to contribute to an AI training and evaluation project covering a broad range of topics.

The work involves analyzing and annotating data, reviewing AI-generated responses, identifying issues with accuracy or reasoning, and providing clear, structured written feedback. No previous AI experience is required. This opportunity is particularly suited to people who are comfortable learning new topics quickly, following detailed guidelines, and producing consistently high-quality work.

CONTRACT: Part-time/hourly contractor assignment

LOCATIONS: Remote, GLOBAL

HOURLY RATE: $50-$90/h

Responsibilities

  • Analyze and evaluate a variety of data and AI-generated content.
  • Annotate information according to project-specific guidelines.
  • Review AI outputs for accuracy, relevance, clarity, and quality.
  • Identify errors, inconsistencies, weak reasoning, and missing information.
  • Provide clear written feedback and recommendations.
  • Complete problem-solving and reasoning tasks across different subject areas.
  • Follow detailed project guidelines and evaluation criteria consistently.
  • Participate in quality-assurance and review processes.
  • Communicate findings and issues clearly with the project team.
  • Maintain high attention to detail across assigned tasks.

Requirements
  • Excellent written and spoken English.
  • Strong critical-thinking and analytical skills.
  • Ability to evaluate information and identify logical or factual problems.

Skills Required

  • Excellent written and spoken English
  • Strong critical-thinking and analytical skills
  • Ability to evaluate information and identify logical or factual problems
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6 Employees

What We Do

Gramian Consulting Group is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong foundation in software engineering and leadership, the firm helps organizations build high-performing teams by matching them with qualified professionals. They specialize in talent augmentation and recruiting, specifically focusing on connecting engineering and data/AI talent with organizations to unlock real business value.

Similar Jobs

Canva Logo Canva

AI Quality Evaluator - Hindi (12-month contract)

Digital Media • Information Technology • Software • Design
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
5500 Employees

Micron Technology Logo Micron Technology

Analyst, GQ OPS-Tactical Planner

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Micron Technology Logo Micron Technology

Principal Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Mondelēz International Logo Mondelēz International

EOP O9 Global Test Lead

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
Mumbai, Maharashtra, IND
90000 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account