Data annotation job
Open Source Applied Engineer Talent Network
Mercor · Posted 15 months ago
- AI evaluation
- Coding
About this role
Mercor is seeking an exceptional open source contributor with deep expertise in Python, Java, C, JavaScript, or TypeScript to collaborate on high-impact projects with global reach. This role is ideal for engineers with a strong command of core programming fundamentals and a proven track record of consistent, high-quality contributions to leading open-source repositories.
Key Responsibilities
- Design and oversee the creation of evaluations for a wide range of coding tasks across multiple languages, including JavaScript, TypeScript, Python, Java, and C.
- Develop test cases to accurately assess system performance in diverse engineering scenarios.
- Analyze system behavior on real-world user use cases to uncover strengths and improvement areas.
- Communicate evaluation results effectively to the research team to support continued development and optimization.
You're a great fit if you have
- A strong GitHub (or similar) presence with frequent, high-quality contributions to top open-source projects in the last 12 months.
- Expertise in one or more of the following languages: Python, Java, C, JavaScript, or TypeScript.
- Deep familiarity with widely-used libraries, frameworks, and tools in your language(s) of choice.
- Excellent understanding of software architecture, performance tuning, and scalable code patterns.
- Strong collaboration skills and experience working within distributed, asynchronous teams.
- Confidence in independently identifying areas for contribution and executing improvements with minimal oversight.
- Comfortable using Git, CI/CD systems, and participating in open-source governance workflows.
This listing is aggregated by DataAnnotationJobs.org. Applications are processed by Mercor, not by this site.
Mercor is an AI-native talent marketplace connecting vetted domain experts such as doctors, lawyers, and engineers directly with frontier AI labs for RLHF, evaluation, and specialized training data at massive scale. See all Mercor jobs.
Apply for this role
Your details first, then a short screening test. Both are read as part of your application and go to Mercor, and we will tell you when similar roles appear.