AI Systems Developer and Evaluator - Remote

Overview

This role involves contributing to the development and evaluation of advanced AI systems designed to replicate real-world workflows across various computer science domains.

In Short

• Create and assess complex problems in computer science across various subdomains such as algorithms, data structures, operating systems, computer architecture, databases, programming languages, and machine learning
• Evaluate AI-generated responses for conceptual accuracy, technical rigor, and domain relevance
• Provide clear written feedback on computer science problem sets, code solutions, and explanations
• Collaborate asynchronously with AI researchers and engineers to iterate and improve model performance
• Ensure technical accuracy and academic precision in all computer science content used to train or evaluate AI systems

Requirements

• PhD in Computer Science or a directly related field from a top university
• 2+ years of academic experience (research, publication, teaching) or professional experience (software engineer, researcher, or computer scientist)
• Deep subject-matter expertise across core areas of computer science
• Exceptional written and verbal communication skills
• Strong attention to detail and analytical thinking

Benefits

• Start Date: Immediate
• Duration: 1–2 months
• Commitment: Part-time, ~20 hours/week (potential to extend to 40 hours/week)
• Schedule: Fully remote and asynchronous – flexible working hours
• Competitive hourly rate based on experience ($75–$95 USD/hr)
• Independent contractor with weekly payment via Stripe Connect