MLOps Engineer - Remote

Overview

Transform Language Models into Real-World Applications. This role is a global role with hybrid work arrangement - combining flexible remote work with in-office collaboration at our HQ.

In Short

• Run and manage open-source models efficiently, optimizing for cost and reliability
• Ensure high performance and stability across GPU, CPU, and memory resources
• Monitor and troubleshoot model inference to maintain low latency and high throughput
• Collaborate with engineers to implement scalable and reliable model serving solutions
• Likes ownership and independence
• Believe clarity comes from action - prototype, test, and iterate
• Stay calm and effective in startup chaos
• Bias for speed - deliver valuable solutions quickly
• See feedback and failure as part of growth
• Possess humility, hunger, and hustle

Requirements

• Experience with model serving platforms such as vLLM or HuggingFace TGI
• Proficiency in GPU orchestration using tools like Kubernetes, Ray, Modal, RunPod, LambdaLabs
• Ability to monitor latency, costs, and scale systems efficiently
• Experience setting up inference endpoints for backend engineers

Benefits

• Flat structure & real ownership
• Full involvement in direction and consensus decision making
• Flexibility in work arrangement
• High-impact role with visibility across product, data, and engineering
• Top-of-market compensation and performance-based bonuses
• Global exposure to product development
• Lots of perks - housing rental subsidies, cafeteria, and overtime meals
• Health, dental & vision insurance
• Global travel insurance for you & your dependents
• Unlimited, flexible time off