Evaluator for Enterprise IT & Cloud Research - Remote

Overview

Mercor is looking for experienced evaluators to support a critical evaluation workflow in partnership with a leading AI research lab. This project focuses on improving model performance in the Enterprise IT & Cloud domain by evaluating agent-generated research reports that delve into the latest trends, technologies, and strategies in IT infrastructure, cloud computing, and enterprise solutions.

In Short

• Evaluate the quality and relevance of agent-generated research reports on Enterprise IT & Cloud topics.
• Provide structured feedback using a provided rubric.
• Work asynchronously and independently.
• Maintain a high level of accuracy and consistency.
• Part-time (20–40 hours/week) with flexible scheduling.
• 100% remote and asynchronous — work from anywhere.
• Contractor position via Mercor, paid hourly.
• Competitive rates: $20–$30/hour depending on expertise.
• Weekly payments processed securely through Stripe Connect.

Requirements

• Strong backgrounds in Enterprise IT, Cloud Computing, or IT infrastructure.
• Experience or knowledge in cloud technologies, IT services, or enterprise software solutions.
• Understanding of current trends in IT and cloud computing.
• Ability to critically assess the quality and accuracy of technical research.
• Comfort providing feedback on complex technical subjects.

Benefits

• Part-time (20–40 hours/week) with flexible scheduling.
• 100% remote and asynchronous — work from anywhere.
• Contractor position via Mercor, paid hourly.
• Competitive rates: $20–$30/hour depending on expertise.
• Weekly payments processed securely through Stripe Connect.