Data annotation job
Video Caption Auditor Expert
Mercor · Posted Yesterday
- Data annotation
- AI evaluation
- LLM training
- Vision
About this role
We're looking for detail-oriented annotators to join a short-term, fast-moving project reviewing captions on egocentric (first-person) video, footage recorded from a head-mounted camera showing someone's hands performing everyday tasks like cooking, cleaning or crafting. You'll audit whether a written caption accurately describes what happens in a short video segment, and give each caption a clear verdict. The project is already underway, so we're prioritising people who can start quickly.
What You'll Do
For each video segment and its caption, you'll decide
- Approve, the caption accurately describes the action
- Reject, the caption has an error, rated Major or Minor, with the reason(s), for example:
- Wrong main verb (e.g. "wring" when the person is rubbing)
- A main action that is added, missing or out of order
- Wrong object or tool, or the wrong / swapped hand (left vs. right)
- Exclude, the footage itself is unusable (corrupted, badly mounted camera, broken segment boundaries)
- You'll follow a detailed written guideline with clear rules and examples, and judge only what is visible in each segment.
Who We're Looking For
- Excellent attention to detail and patience for careful, repetitive visual review
- Reliable left/right reasoning from the camera wearer's point of view
- Strong English reading comprehension and a precise sense of word meaning (e.g. the difference between "wipe", "rub" and "scrub")
- Ability to learn a detailed guideline quickly and apply it consistently
- Good judgment on ambiguous cases
- Nice to have: prior experience in video annotation, data labelling, content moderation, QA, or AI training/evaluation work.
Why Join Us?
- Contribute to Cutting-Edge AI Development: Play a direct role in improving how advanced AI models understand and interpret real-world human actions through first-person video.
- Flexible, Remote Work: Work from anywhere while contributing to a structured, high-impact AI annotation project.
- Clear Guidelines and Expectations: Benefit from detailed instructions, practical examples, and well-defined evaluation criteria to help you deliver high-quality work.
- Apply Your Attention to Detail: Put your observational skills, language comprehension, and critical thinking to work on meaningful AI evaluation tasks.
- Opportunity for Future Projects: Strong performance may open doors to additional AI training, annotation, and evaluation opportunities.
- Quick Onboarding: Join an active project with an accelerated onboarding process, allowing qualified candidates to begin contributing promptly.
This listing is aggregated by DataAnnotationJobs.org. Applications are processed by Mercor, not by this site.
Mercor is an AI-native talent marketplace connecting vetted domain experts such as doctors, lawyers, and engineers directly with frontier AI labs for RLHF, evaluation, and specialized training data at massive scale. See all Mercor jobs.
Apply for this role
Your details first, then a short screening test. Both are read as part of your application and go to Mercor, and we will tell you when similar roles appear.