AI Agent Evaluator - Remote

Overview

This project aims to test and evaluate one AI agent in the development stage. By asking questions and requests, based on various categories (the training is provided), you will try to force the AI agent to say something harmful, offensive, dangerous or toxic and evaluate its responses.

In Short

• Test and evaluate an AI agent in development.
• Ask questions and requests based on provided training.
• Identify harmful, offensive, dangerous, or toxic responses.
• Work towards making the AI agent safer for end users.
• Fully remote position.
• Full-time role with a duration of several months.
• Training will be provided online before the project starts.
• Potential for project duration extension based on progress.

Requirements

• Ability to critically evaluate AI responses.
• Strong communication skills.
• Familiarity with AI concepts is a plus.
• Willingness to participate in training.

Benefits

• Work from anywhere in a fully remote setup.
• Gain experience in AI evaluation.
• Opportunity to contribute to safer AI development.