AI Test Engineer - Remote

Overview

As an AI Test Engineer at ObviouslyAI, you will work hands-on with AI agents and backend services, ensuring systems behave reliably while exploring new tools and designing user-centric tests.

In Short

• Join a fast-growing company focused on AI solutions.
• Write and debug backend code in Python or JavaScript.
• Design test strategies for AI agents, particularly LLM-based agents.
• Evaluate AI outputs and contribute to metrics using tools like Deepchecks.
• Implement APIs and manage authentication workflows.
• Collaborate with cross-functional teams in a startup environment.
• Continuously learn new frameworks and tools.
• Work with integrations like HubSpot and Salesforce.
• Build automation frameworks and scripts for testing.
• Anticipate edge cases and failure modes from a user's perspective.

Requirements

• Experience in Python or JavaScript programming.
• Familiarity with AI testing and evaluation.
• Experience with automation tools like Selenium is a plus.
• Strong problem-solving skills and a creative mindset.
• Ability to learn new tools quickly without handholding.
• Experience with API integrations is beneficial.
• Strong collaboration skills in a team environment.
• Experience in a startup or fast-paced environment is a plus.

Benefits

• Flexible working hours.
• Opportunity to work with cutting-edge AI technology.
• Be part of a small, dynamic team.
• Access to world-class data science talent.
• Potential for career growth in a fast-growing company.