Content Specialist - Conversational AI Quality - Remote

Overview

We are seeking a highly skilled Conversational AI Content & Quality Specialist to join our team. In this role, you will write, review, edit, and evaluate content, with a focus on improving AI model conversational quality through expert prompt engineering and annotation. This position requires exceptional editorial judgment, deep experience with AI tools, and the ability to assess and enhance conversational experiences in emerging generative AI technologies.

In Short

• Write, edit, and review a variety of content, from creative copy to AI model prompts.
• Perform qualitative annotation and evaluation of AI model outputs, assessing conversationality and overall quality.
• Identify and address conversational quality issues through effective prompting practices.
• Design, test, and refine system prompts using clear, compelling natural language to improve AI performance.
• Apply and interpret guidelines with critical thinking, adapting to novel or ambiguous scenarios.
• Conduct analysis and produce actionable insights for cross-functional teams.
• Maintain high standards of accuracy and consistency when reviewing content at scale.
• Collaborate with content and product teams to enhance user experience.
• Support quality control for large datasets on nuanced topics such as politics, bias, gender, and religion.
• Work extended or weekend schedules as required.

Requirements

• 6+ years in journalism, digital content strategy, production, or related fields.
• Demonstrated expertise in prompt engineering, annotation, and AI tool usage.
• Strong editorial judgment and experience reviewing sensitive or nuanced subject matter.
• Excellent writing, editing, and communication skills (familiarity with AP Style preferred).
• Proficiency in spreadsheet tools (Google Sheets, MS Excel) and basic data visualization.
• Ability to work independently and manage multiple priorities in a fast-paced environment.

Benefits

• Dental insurance
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Retirement plan
• Vision insurance