Data annotation job
HR Expert
Mercor · Posted Yesterday
$95/hrRemote (US)Contract
- AI evaluation
- LLM training
About this role
Role Overview
- Mercor is hiring experienced HR professionals to build and review evaluation tasks for AI agents.
- Each task is set in a realistic simulated company, with the policies, employee records, case files, emails and HR systems a people team really uses.
- You make sure each task reads like a real request, the reference answer holds up against the source records, and the grading rubric checks what a senior HR leader would check.
Key Responsibilities
- Refine AI-drafted task prompts so they read like a real request from an HR director or manager, without giving the answer away.
- Check the reference answer against the world's files and app records, and correct what is wrong.
- Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss.
- Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
- Work across talent acquisition and onboarding, performance management and succession, compensation, benefits and leave, employee relations and workplace investigations, separations, HR policy and employment-law compliance, people analytics, and organization design.
Ideal Qualifications
- 3+ years of HR experience. A leadership title or major-company background is a plus, but time in the field matters more.
- Bachelor's degree in human resources, business or a related field.
- Ownership of talent programs, employee-relations matters or compensation design, and working knowledge of employment law (Title VII, FLSA, ADA, or UK / EU equivalents).
- SHRM-SCP, SPHR or an international equivalent strongly preferred. Prior experience on a Mercor RL project is a plus.
Details
- Pay: $95/hour.
- You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away.
- Strong performers can move into reviewer and world lead roles.
This listing is aggregated by DataAnnotationJobs.org. Applications are processed by Mercor, not by this site.
Mercor is an AI-native talent marketplace connecting vetted domain experts such as doctors, lawyers, and engineers directly with frontier AI labs for RLHF, evaluation, and specialized training data at massive scale. See all Mercor jobs.
Apply for this role
Your details first, then a short screening test. Both are read as part of your application and go to Mercor, and we will tell you when similar roles appear.