Expert Rater Project - Italian (Spain)

Posted 11 Hours Ago
Be an Early Applicant
Hiring Remotely in Spain
Remote
20-20 Hourly
Junior
Artificial Intelligence • Machine Learning • Natural Language Processing • Professional Services
The Role
Lead and mentor rater teams to ensure consistent, unbiased annotations and gold set creation. Facilitate client test rounds, analyze datasets and KPIs, craft client communications, collaborate with R&D, and independently evaluate and improve rating quality for AI-powered advertising systems.
Summary Generated by Built In
Overview

As an Expert Rater (ER), you will specialize in providing Rater's support and guidance. You will be instrumental in enhancing the knowledge and skills of other Raters, with a particular focus on developing their rating expertise. Your responsibilities include facilitating client test rounds, understanding templates and workflows, cascading quality expectations to the broader Raters team, and actively monitoring progress and deliverables to meet client expectations. Additionally, you will play a key role in coaching and mentoring Raters, ensuring they gain the necessary skills to improve rating accuracy and decision-making. Your expertise will contribute to elevating the overall quality of our AI-powered advertising systems. 

MAIN RESPONSIBILITIES: 

  • Support Raters in skill development, guiding them in best practices for accurate and consistent ratings. 
  • Ensure annotation selection and gold set creation adheres to template instructions, guaranteeing unbiased outcomes that are reached through elaborate peer-driven consensus. 
  • Analyze diverse datasets to identify significant patterns and trends, demonstrating proficiency in interpreting and utilizing KPIs to drive data-informed decision-making. 
  • Employ strategic questioning techniques to gather information, enhance understanding, and stimulate critical thinking for effective problem-solving and decision-making. 
  • Craft written materials such as emails, questions, and feedback specifically customized for client communication, ensuring clarity and relevance. 
  • Facilitate information or concepts to audiences using relevant documentation and clear communication strategies to align with specific client objectives. 
  • Collaborate with research and development teams in experiments aimed at enhancing the client’s data. 
  • Work closely with clients and CEM to conduct test rounds, gain insights into their requirements, and understand the quality benchmarks expected. 
  • Conduct evaluations independently to sustain and enhance the level of proficiency or skill in particular projects. 
Project Details
 
Job Title: Expert Rater
Local: Italian 
Location: Spain
Hourly Rate: $19.55/hour
Capacity:  30hours/week (with the possibility of an extension to 40hours/week) 
Project Duration: 1 Month
Employment Type: Freelance (with the possibility of a Full-time employment extension based on performance and project needs) 
Start Date: 27th July 

QUALIFICATIONS: 

  • Active Listening Skills: Engage with speakers attentively, seek clarification, provide feedback, and demonstrate empathy to comprehend their message deeply. 
  • Effective Communication and Empathy: Clearly express thoughts, emotions, and needs while respecting others' perspectives, communicating assertively yet respectfully. 
  • Proactiveness: Anticipate and prepare for future needs or obstacles to tackle them efficiently before they arise. 
  • Cultural Adaptability: Navigate differences in values, behaviors, and communication styles to foster effective interactions in diverse cultural contexts. 
  • Psychological Safety Cultivation: Create an atmosphere where individuals feel safe expressing themselves, taking risks, and sharing ideas without fear of criticism. 
  • Research Skills: Methodically explore online sources to extract data, insights, or knowledge relevant to specific topics and cross-reference information. 

KNOWLEDGE: 

  • Knowledge of Italian Language Required 
  • Knowledge of English B2 - Required (Oral and written comprehension) 
  • Google Workspace - Intermediate proficiency 
  • Understanding of U.S. and project locale customs and societal norms 
  • Ability to evaluate and discern content thoughtfully and understand its societal impact 
  • Understanding of survey structures and data collection methodologies  

REQUIREMENTS: 

  • 1+ years of rating experience required
  • Understanding of data labeling, annotation, and evaluation methodologies - Required 
  • An academic background in social sciences or quality roles is a plus 

Why join Welo Data?  
✨ Limitless Flexibility: Work on projects that fit your schedule while collaborating with a global leader in AI data services and localization.  
🌱 Limitless Growth: Apply your skills, access diverse content types, develop through structured learning, and explore career paths that can lead to permanent roles.  
🌍 Limitless Support: Be part of a global community with real-time assistance from our Community Experience team.  
 
How to Apply? 
Apply now by answering a few quick questions to join our database and become part of our growing community.  
 
We can’t wait to meet you!  
 
About Welo Data  
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries. 
 
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms. 

Skills Required

  • 1+ years of rating experience
  • Understanding of data labeling, annotation, and evaluation methodologies
  • Knowledge of Italian language
  • English proficiency at B2 level (oral and written comprehension)
  • Google Workspace - Intermediate proficiency
  • Active listening skills
  • Effective communication and empathy
  • Proactiveness and ability to anticipate obstacles
  • Cultural adaptability to navigate diverse contexts
  • Ability to cultivate psychological safety
  • Research skills including online sourcing and cross-referencing
  • Understanding of U.S. and project locale customs and societal norms
  • Ability to evaluate content thoughtfully and understand societal impact
  • Understanding of survey structures and data collection methodologies
  • Academic background in social sciences or quality roles
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6,543 Employees

Similar Jobs

Pfizer Logo Pfizer

Director, Medical Insights

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
35 Locations
121990 Employees
177K-294K Annually

CrowdStrike Logo CrowdStrike

Senior Marketing Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
Spain
11000 Employees

Affirm Logo Affirm

Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
Spain
2200 Employees
57K-87K Annually

SailPoint Logo SailPoint

Account Executive

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
Spain
2461 Employees

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
New York, New York
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account