Senior QA Analyst, AI & Threat Analytics - Remote

Overview

Keeper is hiring a talented Senior QA Analyst to join our AI & Threat Analytics team. This can be a 100% remote position from select locations with an opportunity to work a hybrid schedule for candidates based in the El Dorado Hills, CA or Chicago, IL metro area.

In Short

• Lead testing efforts for AI-driven features and machine learning models.
• Design and execute test strategies for model accuracy and reliability.
• Hands-on Python automation expertise required.
• Collaborate with ML engineers and security teams.
• Validate security, privacy, and zero-trust requirements.
• Conduct regression testing on ML models.
• Analyze logs and metrics for performance issues.
• Develop automation scripts for model performance validation.
• Test LLM-based features for accuracy and effectiveness.
• Ensure AI features meet quality and performance standards.

Requirements

• Strong analytical and evaluation skills.
• Experience in testing nondeterministic systems.
• Proficiency in Python for automation.
• Familiarity with AI and machine learning concepts.
• Experience in regression testing and validation processes.
• Ability to collaborate with cross-functional teams.
• Knowledge of security and privacy requirements.
• Experience in analyzing logs and performance metrics.

Benefits

• Work in a fast-growing cybersecurity company.
• Opportunity to work remotely or hybrid.
• Be part of a team transforming cybersecurity.
• Engage with next-generation AI features.
• Work with a diverse and global team.