Expert Rater Project - English (US)

MAIN RESPONSIBILITIES: 

• Support Raters in skill development, guiding them in best practices for accurate and consistent ratings. 

• Ensure annotation selection and gold set creation adheres to template instructions, guaranteeing unbiased outcomes that are reached through elaborate peer-driven consensus. 

• Analyze diverse datasets to identify significant patterns and trends, demonstrating proficiency in interpreting and utilizing KPIs to drive data-informed decision-making. 

• Employ strategic questioning techniques to gather information, enhance understanding, and stimulate critical thinking for effective problem-solving and decision-making. 

• Craft written materials such as emails, questions, and feedback specifically customized for client communication, ensuring clarity and relevance. 

• Facilitate information or concepts to audiences using relevant documentation and clear communication strategies to align with specific client objectives. 

• Collaborate with research and development teams in experiments aimed at enhancing the client’s data. 

• Work closely with clients and CEM to conduct test rounds, gain insights into their requirements, and understand the quality benchmarks expected. 

• Conduct evaluations independently to sustain and enhance the level of proficiency or skill in particular projects.  

QUALIFICATIONS: 

• Active Listening Skills: Engage with speakers attentively, seek clarification, provide feedback, and demonstrate empathy to comprehend their message deeply. 

• Effective Communication and Empathy: Clearly express thoughts, emotions, and needs while respecting others' perspectives, communicating assertively yet respectfully. 

• Proactiveness: Anticipate and prepare for future needs or obstacles to tackle them efficiently before they arise. 

• Cultural Adaptability: Navigate differences in values, behaviors, and communication styles to foster effective interactions in diverse cultural contexts. 

• Psychological Safety Cultivation: Create an atmosphere where individuals feel safe expressing themselves, taking risks, and sharing ideas without fear of criticism. 
• Research Skills: Methodically explore online sources to extract data, insights, or knowledge relevant to specific topics and cross-reference information. 

KNOWLEDGE: 

• Knowledge of English Language Required (Oral and written comprehension). 

• Google Workspace - Intermediate proficiency 

• Understanding of U.S. and project locale customs and societal norms 

• Ability to evaluate and discern content thoughtfully and understand its societal impact 

• Understanding of survey structures and data collection methodologies  

REQUIREMENTS: 

• 1+ years of rating experience required 

• Understanding of data labeling, annotation, and evaluation methodologies - Required 

• An academic background in social sciences or quality roles is a plus