Research Engineer, Tokens (Pre-training) - Remote

Overview

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

In Short

• You will be responsible for pretraining data research.
• Understand pretraining data trends and scaling laws.
• Optimize pretraining data mixes.
• Investigate potential new sources of data.
• Build research tools to better understand experimental results.
• Process and use pretraining data effectively.
• Work in a results-oriented and empirical research environment.
• Care about the societal impacts of your work.
• Collaborate with a diverse team on large-scale research efforts.
• Participate in frequent research discussions.

Requirements

• Significant software engineering experience.
• Experience with high performance, large-scale ML systems.
• Knowledge of language modeling with transformers.
• Experience with large-scale ETL processes.
• Ability to design ML experiments and research ML fundamentals.
• Experience inspecting and iterating on data.
• Bachelor's degree in a related field or equivalent experience.
• Strong communication skills.
• Flexibility and impact orientation.
• Willingness to pick up slack outside of job description.

Benefits

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.
• Collaborative office space.