Senior AI Infrastructure Engineer - Remote

Overview

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

As a Senior AI Infrastructure Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world.

In Short

• Design, build, and maintain performant, secure, and highly-available backend services/operators.
• Design and build out the IaaS software layer for a new GB200 data center.
• Work on a global multi-exabyte high-performance object store.
• Build advanced observability stacks for customers.
• Collaborate with technical and non-technical team members.
• Strong fundamental software development skills required.
• Experience with Kubernetes internals is a plus.
• Experience with VMs/hypervisors is a plus.
• Experience with high-performance compute, networking, and/or storage is a plus.
• Experience with infrastructure automation tools is beneficial.

Requirements

• 5+ years of professional software development experience.
• Proficiency in at least one backend programming language (Golang desired).
• Experience writing high-performance, well-tested, production quality code.
• Experience with building and operating high-performance micro-service architectures.
• Excellent communication skills.
• Deep experience with Kubernetes internals is a plus.
• Strong systems knowledge across compute, networking, and storage.
• Experience with infrastructure automation tools (Terraform, Ansible).
• Experience with monitoring/observability stacks (Prometheus, Grafana).
• Experience building IaaS or PaaS systems at scale is a plus.

Benefits

• Competitive compensation.
• Startup equity.
• Health insurance.
• Flexibility in terms of remote work.
• Opportunity to work on cutting-edge AI technologies.