Data Infra Engineer, Pretraining - Remote

Overview

Anthropic is seeking a Research Engineer to join our Pretraining team, responsible for developing the next generation of large language models, focusing on safe and trustworthy AI systems.

In Short

• Design and implement high-performance data processing infrastructure.
• Develop and maintain core processing primitives.
• Build robust systems for data quality assurance.
• Implement monitoring systems for data processing.
• Create distributed computing systems for web-scale datasets.
• Collaborate with research teams on data processing architectures.
• Document infrastructure components and systems.
• Design systems for reproducibility in data preparation.

Requirements

• Strong software engineering skills in distributed systems.
• Expertise in Python and distributed computing frameworks.
• Deep understanding of cloud computing platforms.
• Experience with fault-tolerant system design.
• Background in performance optimization.
• Excellent problem-solving skills.
• Strong communication skills.

Benefits

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.
• Collaborative office space.