Data annotation job
Physician
DataAnnotation · Posted 1 week ago
- Healthcare
- AI evaluation
- LLM training
About this role
Overview
Medical questions are where model mistakes matter most: outdated guidance, missed contraindications, and confident answers that no clinician would sign off on.
As a Physician you'll evaluate AI clinical reasoning against current standards of care and write the answers a careful clinician would give.
What you’ll actually do
- Write prompts that probe clinical reasoning: differential diagnosis, treatment planning, and patient communication.
- Review AI output for unsafe, outdated, or unsupported guidance, and rate the quality of the clinical reasoning.
- Write the correct answer when the model falls short, grounded in current evidence and standards of care.
Roles this fits
Common backgrounds: Physician, Clinician.
What we look for
- MD, DO, or equivalent, with clinical experience.
- Comfort explaining clinical reasoning in plain, precise language.
- Clear written English: your explanations are the training signal.
Compensation
$75 to $125+/hr depending on task difficulty and specialization. Many contributors add $10k to $100k+ a year; some make it their full-time income.
About DataAnnotation
DataAnnotation is where 100k+ experts train the world’s leading AI models. $150M+ paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.
Terms
- Engagement: Independent contractor
- Hours: Flexible hours
- Location: Remote
- Payouts: Weekly
This listing is aggregated by DataAnnotationJobs.org. Applications are processed by DataAnnotation, not by this site.
DataAnnotation hires remote contractors to train and evaluate AI models, from generalist review work to specialist tracks in coding, law, medicine, and finance. Its own site reports more than 100,000 contributors and over $150M paid out to date. See all DataAnnotation jobs.
Apply for this role
Your details first, then a short screening test. Both are read as part of your application and go to DataAnnotation, and we will tell you when similar roles appear.