Data annotation job
Legal Expert
Mercor · Posted 3 months ago
- AI evaluation
- LLM training
- Legal
- Writing
About this role
About the Role
Mercor is partnering with a leading AI research lab to train frontier models on rigorous legal reasoning. We're hiring Legal Experts to evaluate and compare model outputs on challenging legal problems, helping shape how the next generation of AI reasons about case law, contracts, and regulation.
Your legal training and professional judgment will ensure each evaluation is accurate, precise, and grounded in real-world legal reasoning.
What You'll Do
- Compare two AI-generated responses to the same prompt and decide which one is better
- Work from the provided input files and read each model's reasoning / thought process to inform your judgment
- Clearly explain why one output outperforms the other, citing legal accuracy, soundness of reasoning, and client-readiness
- Provide written feedback the research team uses to improve model behavior
- Participate in onboarding and specialty calibration sessions
You're a Good Fit If You
- Hold a J.D., LL.B., LL.M., or equivalent law degree, or equivalent professional legal experience
- Have 2+ years of professional experience practicing or researching law (law firm, in-house, government, or judiciary)
- Have strong experience in legal research and legal writing, including case-law analysis
- Demonstrate excellent written communication with high attention to detail
Role Highlights
- Flexible workload: 10 to 20 hours per week
- Role starts immediately; applications reviewed on a rolling basis
This listing is aggregated by DataAnnotationJobs.org. Applications are processed by Mercor, not by this site.
Mercor is an AI-native talent marketplace connecting vetted domain experts such as doctors, lawyers, and engineers directly with frontier AI labs for RLHF, evaluation, and specialized training data at massive scale. See all Mercor jobs.
Apply for this role
Your details first, then a short screening test. Both are read as part of your application and go to Mercor, and we will tell you when similar roles appear.