Compensation AI Evaluation Specialist (Part-Time Contractor)

About the Role

We are seeking experienced compensation professionals to help evaluate and improve AI agents designed for enterprise compensation and rewards use cases.

In this role, you will review outputs generated by AI systems, assess the quality and accuracy of recommendations, identify issues, and provide detailed feedback that helps improve agent performance. This is an opportunity to apply your compensation expertise at the intersection of HR and artificial intelligence.

What You'll Do

• Review AI-generated analyses, recommendations, and compensation-related outputs
• Evaluate responses for accuracy, completeness, consistency, and business relevance
• Identify errors, gaps, unsupported conclusions, or areas for improvement
• Provide clear, actionable written feedback to help improve AI performance
• Apply compensation best practices and professional judgment when assessing outputs
• Follow evaluation guidelines and scoring frameworks
• Document findings with a high degree of attention to detail
• Collaborate with project leads to refine evaluation methodologies

What Success Looks Like

Successful evaluators consistently

• Spot subtle errors and inconsistencies
• Apply compensation expertise to assess quality and business relevance
• Deliver specific, actionable feedback rather than general observations
• Maintain high standards of accuracy and consistency
• Learn quickly and adapt to evolving evaluation criteria

Required Qualifications

• Based in United States
• 5+ years of experience in compensation
• Strong understanding of compensation principles, including:
• Market pricing
• Salary structures and ranges
• Job architecture and leveling
• Compensation benchmarking
• Compensation analysis
• Exceptional attention to detail
• Strong written communication skills
• Ability to provide objective, evidence-based feedback
• Comfortable learning new software and technology tools

Preferred Qualifications

• Experience supporting large enterprise compensation programs
• Experience working with compensation survey data and market intelligence
• Experience evaluating analytical work products or conducting quality reviews
• Familiarity with AI tools such as ChatGPT, Claude, Gemini, or similar technologies
• Curiosity about how AI can be applied to compensation and HR workflows

Once you apply you’ll be sent a link to complete a sample AI evaluation (should take no more than 30 minutes)

Note: This role is focused on evaluating and improving AI-generated outputs. It is not a traditional compensation analyst position and does not involve direct client-facing compensation consulting work.