MLOps Engineer - Remote

Overview

We’re building AI systems for a global audience. This role is a global role with hybrid work arrangement - combining flexible remote work with in-office collaboration at our HQ.

In Short

• Run and manage open-source models efficiently, optimizing for cost and reliability.
• Ensure high performance and stability across GPU, CPU, and memory resources.
• Monitor and troubleshoot model inference to maintain low latency and high throughput.
• Collaborate with engineers to implement scalable and reliable model serving solutions.
• Experience with model serving platforms such as vLLM or HuggingFace TGI.
• Proficiency in GPU orchestration using tools like Kubernetes, Ray, Modal, RunPod, LambdaLabs.
• Ability to monitor latency, costs, and scale systems efficiently with traffic demands.
• Experience setting up inference endpoints for backend engineers.
• Flat structure & real ownership.
• Unlimited, flexible time off.

Requirements

• Likes ownership and independence.
• Believe clarity comes from action - prototype, test, and iterate without waiting for perfect plans.
• Stay calm and effective in startup chaos.
• Bias for speed - you believe it’s better to deliver something valuable now than a perfect version much later.
• See feedback and failure as part of growth.
• Possess humility, hunger, and hustle, and lift others up as you go.

Benefits

• Top-of-market compensation and performance-based bonuses.
• Global exposure to product development.
• Health, dental & vision insurance.
• Global travel insurance (for you & your dependents).
• Lots of perks - housing rental subsidies, a quality company cafeteria, and overtime meals.