Member of Technical Staff, Post Training Team - Remote

Overview

This role involves advancing the state of the art for model post training, shipping state of the art models to production, and bridging the gap between research and production.

In Short

• Design and write high-performant and scalable software for training models.
• Consistently post-train the models to reach SOTA level performance.
• Coordinate with other specialist teams to produce models with strong performance.
• Implement techniques to improve training cycle performance.
• Research and experiment with ideas on supercompute and data infrastructure.
• Learn from and work with top researchers in the field.

Requirements

• Extremely strong software engineering skills.
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR.
• Experience with distributed training infrastructures (Kubernetes, Slurm).
• Experience using large-scale distributed training strategies.
• Hands on experience on training large models at scale.
• Hands on experience with the post training phase of model training.

Benefits

• An open and inclusive culture and work environment.
• Work closely with a team on the cutting edge of AI research.
• Weekly lunch stipend, in-office lunches & snacks.
• Full health and dental benefits, including mental health budget.
• 100% Parental Leave top-up for 6 months for employees in Canada, US, and UK.
• Personal enrichment benefits towards arts and culture, fitness, and workspace improvement.
• Remote-flexible with co-working stipend.
• 6 weeks of vacation.