Danish LLM Evaluator - Remote

Overview

Join Project Spearmint, a multilingual AI response evaluation project reviewing large language model (LLM) outputs in different languages, focused on either Tone or Fluency. Native-level fluency in a target language, along with strong English comprehension, is required.

In Short

• Evaluate model replies in your native language based on either Tone or Fluency.
• Assess overall quality, correctness, and naturalness of responses.
• Read user prompts and two model replies, then rate each using a five-point scale.
• Provide brief rationales for any extreme ratings.
• Batch 1 – Tone: Evaluate helpfulness, insightfulness, engagement, and fairness of replies.
• Flag formality mismatches, condescension, bias, or tonal issues.
• Batch 2 – Fluency: Assess grammatical accuracy, clarity, coherence, and natural flow.
• Project-based opportunity with CrowdGen as an Independent Contractor.
• Contribute from the comfort of your home.
• Impact the future of AI.

Requirements

• Native-level fluency in Danish.
• Strong comprehension of English.
• Ability to evaluate language quality on a five-point scale.
• Attention to detail in assessing tone and fluency.
• Experience with AI or language evaluation is a plus.

Benefits

• Flexible working hours.
• Work from home.
• Opportunity to contribute to AI development.
• Join a community of evaluators.