Data annotation job
Computer and Information Systems Managers
Mercor · Posted 1 week ago
- AI evaluation
- Coding
About this role
About the Role
Mercor is hiring experienced Computer and Information Systems Managers to help evaluate and improve cutting-edge AI systems. In this role, you'll evaluate AI-generated IT management content and workflows, leveraging your real-world expertise in directing information systems, coordinating technical teams, and overseeing enterprise technology operations.
Key Responsibilities
- Evaluate AI-generated project plans, technical standards, incident responses, and other IT management artifacts for quality and accuracy.
- Compare AI-generated responses head-to-head based on operational soundness, technical rigor, and cross-team feasibility.
- Review IT management scenarios involving system prioritization, vendor coordination, technical support, and team assignment and provide expert feedback.
Required Qualifications
- 4+ years of experience as an Information Technology Manager (IT Manager), Information Systems Manager (IS Manager), IT Director, Application Development Director, Technical Services Manager, or another closely related IT management role.
- Experience directing or coordinating activities across electronic data processing, information systems, systems analysis, or computer programming teams.
- Ability to commit 20+ hours per week.
- Strong written English communication skills.
Additional Information
- Start date: Immediate
- Duration: Approximately 4 to 6 weeks
- Payment: task-based (payment upon first task approval). Experts who complete their first task within the required timeline will then be qualified to be paid hourly for the remainder of the project.
This listing is aggregated by DataAnnotationJobs.org. Applications are processed by Mercor, not by this site.
Mercor is an AI-native talent marketplace connecting vetted domain experts such as doctors, lawyers, and engineers directly with frontier AI labs for RLHF, evaluation, and specialized training data at massive scale. See all Mercor jobs.
Apply for this role
Your details first, then a short screening test. Both are read as part of your application and go to Mercor, and we will tell you when similar roles appear.