AI Agent Evaluator - Remote

Overview

This project aims to test and evaluate one AI agent in the development stage. By asking questions and requests, based on various categories (the training is provided), you will try to force the AI agent to say something harmful, offensive, dangerous or toxic and evaluate its responses.

In Short

• Test and evaluate an AI agent in development.
• Ask questions and requests based on provided training.
• Evaluate AI responses for harmful content.
• Prevent AI from sharing toxic content.
• Fully remote position.
• Full-time role for several months.
• Training provided before the project.
• Work on improving AI safety.
• Collaborate with a team of evaluators.
• Contribute to AI development and safety measures.

Requirements

• Ability to critically evaluate AI responses.
• Strong communication skills.
• Interest in AI and technology.
• Experience in testing or evaluation is a plus.
• Willingness to learn and adapt.
• Attention to detail.
• Ability to work independently.
• Familiarity with online training tools.
• Commitment to project duration.
• Open to feedback and improvement.

Benefits

• Flexible working hours.
• Opportunity to work on cutting-edge AI technology.
• Gain experience in AI evaluation.
• Work in a fully remote environment.
• Collaborate with experts in the field.
• Potential for project extension based on performance.
• Access to training resources.
• Contribute to meaningful AI safety initiatives.
• Networking opportunities in the tech industry.
• Gain insights into AI development processes.