AI Coding Subject-Matter Expert - Remote

Overview

Join a leading AI lab’s cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking talented Coding subject-matter experts (SMEs) from the Software Engineering (SWE) industry to bring deep domain expertise and elevate the quality of our AI training data.

In Short

• Guide research teams to close knowledge gaps and improve AI model performance in the SWE coding domain.
• Create and maintain precise annotation standards tailored to coding.
• Develop guidelines and detailed rubrics/evaluation frameworks to assess model reasoning across tasks.
• Design challenging, domain-relevant tasks, and write accurate and well-structured solutions to SWE Coding problems.
• Evaluate SWE Coding tasks and solutions and provide clear, written feedback.
• Collaborate with other subject matter experts to ensure consistency and accuracy in training data.

Requirements

• Location: Currently living in the US
• Education: Master’s Degree+
• Experience: Familiarity with AI and have a minimum of 2+ years of practice experience at a reputable institution. Experience with Algorithms & Data Structures, Full Stack Development, Big Data & Distributed Systems is a plus.
• Ideal Commitment: ~40hrs/week with a minimum availability of ~20 hrs/week. You'll join calibration calls with the client’s team 2-5x per week.

Benefits

• Pay rate between $90 and $100 per hour.
• Long-term (6-12 months) role directly reporting to the research team of a leading AI lab.
• Flexible, remote work that will have a significant impact on the development of advanced AI models.