Data annotation job
General Physician
Mercor · Posted 3 weeks ago
- AI evaluation
- Safety
- Healthcare
About this role
Mercor is hiring experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab.
You will assess model outputs across diagnosis, clinical reasoning, and care workflows.
Key Responsibilities
- Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical standards
- Score diagnoses, case reasoning, and care recommendations against expert judgment
- Write structured feedback on clarity, safety, and clinical rigor
- Flag failure modes that compromise patient safety
- Collaborate asynchronously with AI researchers to improve model performance
Required Qualifications
- MD or DO from an accredited medical school
- Active, unrestricted US medical license
- Residency complete
- Currently practicing and seeing patients
- 3+ years of post-residency experience in your current role strongly preferred
- Practice in primary care, internal medicine, and hospital-based specialties (Primary Care, General Internal Medicine, Family Medicine, Emergency Medicine, Critical Care)
- Sharp attention to detail and clear written communication
- Located in the US
Project Timeline
- Start Date: Immediate
- Duration: 6 weeks
- Commitment: Part-time, 20+ hours per week
Application & Onboarding
- Upload your resume and application form
- Complete a 25-minute conversational interview on your background, experience, and motivations
- Credential verification: license status, residency completion, and current practice setting
- Final roster placement is confirmed with the project team before your start date
- Receive next steps and onboarding details within a few days
Apply today and put your clinical expertise to work shaping the health models clinicians and patients will rely on.
This listing is aggregated by DataAnnotationJobs.org. Applications are processed by Mercor, not by this site.
Mercor is an AI-native talent marketplace connecting vetted domain experts such as doctors, lawyers, and engineers directly with frontier AI labs for RLHF, evaluation, and specialized training data at massive scale. See all Mercor jobs.
Apply for this role
Your details first, then a short screening test. Both are read as part of your application and go to Mercor, and we will tell you when similar roles appear.