Business Analyst: Non-US Raters

Posted One Month Ago
6 Locations
Remote
15-15 Hourly
Mid level
Artificial Intelligence • HR Tech • Professional Services • Software
The Role
Evaluates and compares AI chatbot responses using predefined criteria for accuracy, relevance, completeness, clarity, and quality. Documents findings, analyzes business requirements, maps processes, identifies response-quality issues, prepares reports, and collaborates with project teams. The role is a fully remote, full-time 16-week contract requiring five days per week, possible weekend work, and at least four hours of overlap with US Pacific Time.
Summary Generated by Built In

This role is for one of our clients

We are seeking detail-oriented and analytical Business Analysts – Non-US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, applying predefined evaluation criteria, conducting structured assessments, and delivering accurate, well-documented judgments.

Candidates should have strong analytical skills, business analysis experience, attention to detail, and the ability to work independently in a remote, fast-paced environment. This opportunity is suitable for professionals interested in contributing to AI evaluation and improving the quality, relevance, and reliability of AI-generated responses.

Job Details

  • Role: Business Analyst – Non-US Raters
  • Experience: 3+ years
  • Employment Type: Short-term contract
  • Contract Duration: 16 weeks
  • Location: Argentina, Peru, Mexico, Brazil, Chile, Colombia, India, and Pakistan
  • Compensation: USD 15 per hour
  • Start Date: Immediate
  • Work Mode: Fully remote
  • Availability: Full-time commitment of 8 hours per day
  • Time Zone Requirement: Minimum 4 hours of overlap with the US Pacific Time (PST) time zone
  • Work Schedule: Five working days per week, including weekends when required, with two weekdays off

Requirements

Key Responsibilities

  • Review, analyze, and compare responses generated by multiple AI chatbots against predefined evaluation criteria.
  • Conduct structured assessments to determine the accuracy, relevance, completeness, clarity, and overall quality of chatbot responses.
  • Analyze business requirements and translate them into clear evaluation guidelines and functional specifications.
  • Gather, interpret, and document relevant information to support consistent and objective assessments.
  • Examine workflows, processes, and data to identify gaps, inconsistencies, and opportunities for improvement.
  • Prepare evaluation reports, summaries, and supporting documentation with a strong focus on accuracy.
  • Collaborate with project managers and cross-functional teams to clarify requirements and resolve evaluation-related questions.
  • Track task progress, quality metrics, and project deliverables while meeting established deadlines.
  • Identify recurring response-quality issues and provide actionable observations based on the defined assessment framework.
  • Maintain consistency, confidentiality, and high-quality standards throughout the evaluation process.

Required Qualifications and Skills

  • Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
  • At least 3 years of experience as a Business Analyst or in a similar analytical role.
  • Strong analytical thinking, problem-solving, and decision-making abilities.
  • Excellent written communication skills and the ability to explain findings clearly.
  • Strong attention to detail and the ability to assess information objectively.
  • Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or comparable analytical tools.
  • Experience with requirement gathering, process mapping, and business documentation.
  • Ability to work independently, manage multiple priorities, and meet strict deadlines.
  • Strong documentation skills and the ability to follow structured evaluation guidelines.
  • Familiarity with Agile or Scrum methodologies is an advantage.
  • Willingness to commit to a full-time, 16-week remote engagement with the required time-zone overlap.

Engagement Benefits

  • Opportunity to contribute to projects focused on AI evaluation and response quality.
  • Fully remote work arrangement with the flexibility of working from your location.
  • Exposure to structured AI assessment workflows and quality evaluation processes.
  • Opportunity to contribute to projects with international reach.
  • Clearly defined contract duration, hourly compensation, and evaluation responsibilities.

    Important Engagement Details

    • This is a project-based contract lasting 16 weeks.
    • Work will consist of evaluating multiple chatbot responses and submitting a final assessment for each assigned task.
    • Candidates must be available for 8 hours per day, five days per week, with four hours of overlap with US Pacific Time.
    • The schedule may include weekend work, with two weekdays off each week.
    • Candidates are expected to maintain consistent evaluation quality, follow project guidelines, and complete assigned tasks within the required timelines.

    Skills Required

    • Bachelor's degree in Business Administration, Finance, Computer Science, or a related field
    • At least 3 years of experience as a Business Analyst or in a similar analytical role
    • Strong analytical thinking, problem-solving, and decision-making abilities
    • Excellent written communication skills and ability to explain findings clearly
    • Strong attention to detail and ability to assess information objectively
    • Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or comparable analytical tools
    • Experience with requirements gathering, process mapping, and business documentation
    • Ability to work independently, manage multiple priorities, and meet strict deadlines
    • Strong documentation skills and ability to follow structured evaluation guidelines
    • Familiarity with Agile or Scrum methodologies
    • Availability for a full-time, 16-week remote engagement with required time-zone overlap
    • Availability for 8 hours per day, five days per week, including weekends when required
    Am I A Good Fit?
    beta
    Get Personalized Job Insights.
    Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

    The Company
    HQ: Stockholm
    Year Founded: 2021

    What We Do

    Weekday is an AI-powered recruitment platform that helps startups hire top-tier engineering and product talent. By leveraging a massive database of white-collar professionals and advanced outreach tools, the company streamlines the hiring process through automated sourcing, AI-driven resume screening, and white-glove contingency services. Their mission is to modernize recruitment by enabling companies to discover and engage passive candidates efficiently, ensuring high-quality hires for critical roles.

    Similar Jobs

    Luxury Presence Logo Luxury Presence

    Tech Lead Manager, Mid Market & Celebrity - LATAM (Remote)

    Marketing Tech • Real Estate • Software • PropTech • SEO
    Easy Apply
    Remote or Hybrid
    12 Locations
    500 Employees

    Circle (circle.so) Logo Circle (circle.so)

    Operations Coordinator

    Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
    Remote
    32 Locations
    250 Employees

    Circle (circle.so) Logo Circle (circle.so)

    IT Coordinator

    Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
    Remote
    40 Locations
    250 Employees
    Remote or Hybrid
    2 Locations
    289097 Employees

    Similar Companies Hiring

    Blee Thumbnail
    Artificial Intelligence • Marketing Tech • Software
    New York, New York
    33 Employees
    Vega Thumbnail
    Artificial Intelligence • Automotive • Insurance • Transportation
    US
    65 Employees
    VCA Animal Hospitals Thumbnail
    Pet • Professional Services
    Los Angeles, CA
    35000 Employees

    Sign up now Access later

    Create Free Account

    Please log in or sign up to report this job.

    Create Free Account