Project Perseus | Data Quality Analyst - Italian Speakers (Human-in-the-Loop AI)

Reposted 4 Days Ago
Be an Early Applicant
11 Locations
In-Office or Remote
38-38 Hourly
Mid level
Artificial Intelligence • Machine Learning • Natural Language Processing • Professional Services
The Role
Audit and validate data labeling outputs, provide structured feedback and hands-on training to annotators, monitor workflows and escalate issues, help apply and improve guidelines, and identify patterns in human and model outputs to maintain high-quality AI training data.
Summary Generated by Built In

Welo Data is looking for experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality — bridging Data Labeling Associates (DLAs) and Team Leads to ensure work is not only completed, but done right.

You'll work closely with both people and AI systems — auditing outputs, supporting day-to-day execution, and helping teams apply guidelines correctly in fast-moving, real-world scenarios. The work combines data quality, light project coordination, and hands-on training, where your ability to guide others and think critically is just as important as your own output.

Project Details

  • Job Title: Data Quality Analyst
  • Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston
  • Hours: Full-time, 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
  • Pay Rate: $38/hour
  • Contract Duration: 1-year contract with possibility of extension

Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston. Please only apply if you meet this location requirement.

What You’ll Do

  • Support quality and execution across DLA teams, ensuring work meets defined standards at scale
  • Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency
  • Act as the first line of support for DLAs — answering questions and helping interpret guidelines
  • Help DLAs navigate ambiguity and apply evolving instructions effectively
  • Support onboarding and training of new DLAs through hands-on guidance and coaching
  • Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads
  • Identify patterns, recurring issues, and edge cases in both human and model outputs
  • Participate in calibrations, team discussions, and stakeholder syncs
  • Contribute to improving guidelines, processes, and overall team performance
  • Document findings and feedback in a clear, concise, and actionable way

What We’re Looking For

  • Native-level language proficiency and a university degree (Bachelor’s or higher).
  • B2 or superior level of English.  
  • 2–4 years of experience in data annotation, content quality, QA, or related fields
  • Strong ability to interpret and apply complex guidelines with consistency
  • Excellent attention to detail with a high bar for quality
  • Ability to stay consistent while working with evolving guidelines and priorities
  • Experience in AI/ML data workflows or human-in-the-loop evaluation environments
  • Prior experience auditing or reviewing the work of others
  • Familiarity with safety, compliance, or policy-driven content evaluation

Benefits

  • Paid Vacation: 6 days
  • Paid Company Holidays: 2 days (Memorial Day and Labor Day)
  • Paid Sick Leave: accrued per applicable state law and company policy
  • Medical, Dental, and Vision Insurance (eligibility applies)
  • Health Savings Account (HSA)
  • 401(k) Retirement Plan
  • Employee Assistance Program
  • Additional voluntary benefits (life, accident, critical illness, etc.)
  • Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
  • Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
  • Unique Campus Features: Some locations include roof-top nature parks
  • Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.

Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
 
To know more details (Click here)
 
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.  In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
 
 
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
 
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.

Skills Required

  • Native-level proficiency in Italian
  • University degree (Bachelor's or higher)
  • B2 or superior level of English
  • 2-4 years experience in data annotation, content quality, QA, or related fields
  • Experience in AI/ML data workflows or human-in-the-loop evaluation environments
  • Prior experience auditing or reviewing the work of others
  • Familiarity with safety, compliance, or policy-driven content evaluation
  • Ability to interpret and apply complex guidelines with consistency
  • Must be authorized to work in the U.S. (no visa sponsorship)
  • 100% onsite in specified cities; must be located in or able to commute to listed locations
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6,543 Employees

Similar Jobs

Optum Logo Optum

Sr Applications Project Specialist- Epic Healthy Planet Certified- Kelsey-Seybold Clinic - Pearland Texas - Remote

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Pearland, TX, USA
160000 Employees
92K-164K Annually

Domino Data Lab Logo Domino Data Lab

Staff Software Engineer

Artificial Intelligence • Machine Learning
Easy Apply
Remote or Hybrid
US
200 Employees
200K-250K Annually

Zscaler Logo Zscaler

Detection Engineer- SkillBridge Intern

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees

Metropolis Technologies Logo Metropolis Technologies

Director, Partner Success - Aviation

Artificial Intelligence • Computer Vision • Machine Learning • Payments • Real Estate • PropTech
Easy Apply
Remote
USA
23100 Employees
150K-175K Annually

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
Chicago, Illinois
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account