Compensation AI Evaluation Specialist (Part-Time Contractor)

Compa is a venture-backed AI startup revolutionizing the future of compensation.

In a dynamic job market with hiring challenges, accountability, and the rise of AI, companies need the best data to stay ahead of industry changes, competition, and costs. Compa has developed the premier real-time compensation data platform, delivering top-tier compensation intelligence to leading enterprise teams.

Compa is a compensation intelligence company built to augment enterprise compensation teams in the era of AI.

Our customers include the world’s biggest companies: NVIDIA, Stripe, DoorDash, Open AI, TMobile, Moderna, Workday, Ulta, Target, and more.

Locations:

Compa headquarters are located in Irvine, California, with growing sites in Denver, Colorado and San Francisco, California. We’re a collaborative, curious, and driven team that values transparency, ownership, and continuous learning and prioritizing in person work where possible.

We are seeking experienced compensation professionals to help evaluate and improve AI agents designed for enterprise compensation and rewards use cases.

In this role, you will review outputs generated by AI systems, assess the quality and accuracy of recommendations, identify issues, and provide detailed feedback that helps improve agent performance. This is an opportunity to apply your compensation expertise at the intersection of HR and artificial intelligence.

• Review AI-generated analyses, recommendations, and compensation-related outputs

• Evaluate responses for accuracy, completeness, consistency, and business relevance

• Identify errors, gaps, unsupported conclusions, or areas for improvement

• Provide clear, actionable written feedback to help improve AI performance

• Apply compensation best practices and professional judgment when assessing outputs

• Follow evaluation guidelines and scoring frameworks

• Document findings with a high degree of attention to detail

• Collaborate with project leads to refine evaluation methodologies

Successful evaluators consistently:

• Spot subtle errors and inconsistencies

• Apply compensation expertise to assess quality and business relevance

• Deliver specific, actionable feedback rather than general observations

• Maintain high standards of accuracy and consistency

• Learn quickly and adapt to evolving evaluation criteria

• Flexible, remote work

• Competitive compensation at $100/hour

• Opportunity to shape next-generation AI products for compensation professionals

• Work at the forefront of AI and enterprise HR technology

• Consistent part-time engagement with a minimum commitment of 10 hours per week

• Based in United States

• 5+ years of experience in compensation

• Strong understanding of compensation principles, including:

  • Market pricing

  • Salary structures and ranges

  • Job architecture and leveling

  • Compensation benchmarking

  • Compensation analysis

• Exceptional attention to detail

• Strong written communication skills

• Ability to provide objective, evidence-based feedback

• Comfortable learning new software and technology tools

Preferred Qualifications

• Experience supporting large enterprise compensation programs

• Experience working with compensation survey data and market intelligence

• Experience evaluating analytical work products or conducting quality reviews

• Familiarity with AI tools such as ChatGPT, Claude, Gemini, or similar technologies

• Curiosity about how AI can be applied to compensation and HR workflows

Once you apply you’ll be sent a link to complete a sample AI evaluation (should take no more than 30 minutes)

Note: This role is focused on evaluating and improving AI-generated outputs. It is not a traditional compensation analyst position and does not involve direct client-facing compensation consulting work.