Member of Technical Staff - AI Infrastructure - Remote

Overview

As a Member of Technical Staff at Fluidstack, you will design, develop, and maintain software solutions that power our AI infrastructure and enable our customers to run complex ML workloads efficiently at scale.

In Short

• Developing and optimizing job scheduling systems to maximize GPU utilization and throughput for ML workloads
• Building and improving software interfaces for cluster management that support PyTorch, JAX, and other ML frameworks
• Creating monitoring and observability tools for tracking training progress, resource usage, and system performance
• Implementing data pipeline optimizations to accelerate training and inference workflows
• Designing and developing APIs and services to integrate with MLflow, Kubeflow, Weights & Biases, and other ML tooling
• Writing libraries and utilities to simplify the deployment and management of distributed training jobs

Requirements

• You have developed software for training or serving large-scale ML models (1000+ GPU scale)
• You have optimized distributed training performance across multiple nodes and accelerators
• You have implemented APIs and interfaces for ML platforms that prioritize developer experience
• You have experience with orchestration systems like Kubernetes or SLURM in the context of large scale ML workloads
• You have built or contributed to ML infrastructure tools (e.g., Ray, Horovod, DeepSpeed), and have experience with ML experiment tracking and workflow systems (MLflow, Kubeflow, W&B)

Benefits

• Competitive total compensation package (cash + equity).
• Retirement or pension plan, in line with local norms.
• Health, dental, and vision insurance.
• Generous PTO policy, in line with local norms.
• Fluidstack is remote first, but has offices in key locations. For all other locations, we provide access to WeWork.