MLOps Engineer - Remote

Overview

An MLOps Engineer will work on transforming language models into real-world applications, focusing on building AI systems for a global audience.

In Short

• Run and manage open-source models efficiently.
• Ensure high performance across GPU, CPU, and memory resources.
• Monitor and troubleshoot model inference.
• Collaborate with engineers for scalable model serving solutions.
• Work in a flat structure with real ownership.
• Full involvement in direction and decision-making.
• Flexibility in work arrangement.
• Top-of-market compensation and performance-based bonuses.
• Unlimited, flexible time off.
• Global exposure to product development.

Requirements

• Experience with model serving platforms such as vLLM or HuggingFace TGI.
• Proficiency in GPU orchestration using Kubernetes, Ray, Modal, etc.
• Ability to monitor latency and scale systems efficiently.
• Experience setting up inference endpoints for backend engineers.

Benefits

• Health, dental & vision insurance.
• Global travel insurance for you and your dependents.
• Housing rental subsidies and quality company cafeteria.
• Lots of perks including overtime meals.