AI Research Evaluator in STEM Fields - Remote

Overview

Mercor is seeking PhD holders, doctoral candidates, and exceptional Master’s graduates in biology, physics, chemistry, or related disciplines to join a high-impact AI research initiative in partnership with a leading AI lab. This role involves evaluating and enhancing large language models (LLMs) by applying deep subject-matter expertise in graduate-level science to rigorously benchmark model performance.

In Short

• Evaluate accuracy, scientific depth, and domain relevance of LLM-generated answers across various domains.
• Review outputs spanning advanced topics in molecular biology, genetics, classical mechanics, quantum physics, physical chemistry, computer science, engineering, and humanities.
• Identify factual inaccuracies, logical flaws, and reasoning gaps.
• Work independently and asynchronously using provided tools.
• Part-time position (20 hours/week).
• Remote and asynchronous work environment.
• Contractor position via Mercor.
• Compensation based on expertise.
• Weekly payments via Stripe Connect.

Requirements

• PhD (or PhD candidate) in Biology, Physics, Chemistry, Engineering, Computer Science, Mathematics, or related STEM field.
• Strong familiarity with graduate-level science and research problem solving.
• Excellent written communication and attention to detail.
• Comfortable working independently and remotely.
• Basic Python knowledge preferred, not required.

Benefits

• Flexible working hours.
• Opportunity to work on cutting-edge AI research.
• Engagement with a leading AI lab.
• Remote work flexibility.
• Competitive hourly pay based on expertise.