Staff Software Engineer, Inference - Remote

Overview

The Staff Software Engineer, Inference will be responsible for building and optimizing low-latency inference pipelines for real-time applications in robotics, requiring expertise in distributed systems and ML infrastructure.

In Short

• Build low-latency inference pipelines for on-device deployment.
• Design and optimize distributed inference systems on GPU clusters.
• Implement efficient low-level code (CUDA, Triton, custom kernels).
• Optimize workloads for throughput and latency.
• Develop monitoring and debugging tools for reliability.
• 8+ years of experience in distributed systems or ML infrastructure.
• Production-grade expertise in Python and systems languages.
• Mastery in CUDA, Triton, and kernel optimization.
• Proven track record in scaling inference workloads.
• System-level mindset for hardware-software tuning.

Requirements

• Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years).
• Production-grade expertise in Python, with strong background in systems languages (C++/Rust/Go).
• Low-level performance mastery: CUDA, Triton, kernel optimization, quantization.
• Proven track record scaling inference workloads.
• System-level mindset with a history of tuning hardware-software interactions.

Benefits

• Opportunity to work on cutting-edge technology in robotics.
• Flexible work environment with remote options.
• Collaborative and innovative team culture.
• Competitive salary and benefits package.
• Professional development opportunities.