Senior Research Engineer, Model Evaluation - Remote

Overview

As a Senior Research Engineer, Model Evaluation, you will be responsible for creating next-generation evaluation methods and scalable infrastructure to measure LLM progress.

In Short

• Develop evaluation benchmarks, datasets, and environments for measuring model capabilities.
• Conduct research to improve LLM evaluation methods.
• Build scalable tools for analyzing evaluation results.
• Work with top researchers and engineers in the field.
• Push the limits of LLM capabilities.
• Develop new methods and data for LLM evaluation.
• Strong software engineering skills required.
• Encouragement to apply even if not all qualifications are met.
• Inclusive work environment.
• Full-time position with various perks.

Requirements

• Experience in building evaluation resources for LLMs.
• Publications or contributions to top-tier conferences.
• Experience with LLMs and performance analysis tools.
• Strong software engineering background.

Benefits

• Open and inclusive culture.
• Work on cutting-edge AI research.
• Weekly lunch stipend and in-office perks.
• Comprehensive health and dental benefits.
• Parental leave top-up for specific regions.
• Personal enrichment benefits.
• Remote-flexible work options.
• 6 weeks of vacation.