Software Engineer, Internal Infrastructure - Remote

Overview

Cohere is on a mission to scale intelligence to serve humanity by training and deploying frontier models for developers and enterprises building AI systems. As a Software Engineer in the Internal Infrastructure team, you will contribute to building world-class infrastructure for AI workloads, collaborating closely with researchers to enhance stability and scalability.

In Short

• Build and operate Kubernetes compute superclusters across multiple clouds
• Partner with cloud providers to optimize infrastructure costs, performance, and reliability
• Work with research teams to improve stability and efficiency of AI model training
• Design scalable systems for training AI models
• Encourage software best practices and participate in team processes
• Participate in a 24x7 on-call rotation
• Contribute to Open Source solutions
• Work in a fast-paced environment
• Mentor and share knowledge with team members
• Support and troubleshoot low level Linux systems

Requirements

• Experience running Kubernetes clusters at scale
• Strong programming skills in Go or Python
• Self-directed and adaptable problem solver
• Excellent communication skills
• Experience with ML training infrastructure is a bonus
• Familiarity with RDMA networking is a bonus
• Collaborative experience with research teams is a plus

Benefits

• Open and inclusive culture
• Work with a cutting-edge AI research team
• Weekly lunch stipend and in-office snacks
• Full health and dental benefits
• 100% Parental Leave top-up for 6 months
• Personal enrichment benefits
• Remote-flexible work options
• 6 weeks of vacation