Member of technical staff (Inference) - Remote

Overview

H is hiring the world’s best AI talent to develop scalable, low-latency, and cost-effective inference pipelines for agent technology.

In Short

• Develop scalable, low-latency inference pipelines.
• Optimize model performance using advanced techniques.
• Develop specialized GPU kernels for performance-critical tasks.
• Collaborate with research teams on model architectures.
• Review state-of-the-art papers to improve performance.
• Implement state-of-the-art inference techniques.

Requirements

• MS or PhD in Computer Science, Machine Learning or related fields.
• Proficient in Python, Rust, or C/C++.
• Experience in GPU programming (CUDA, Open AI Triton, etc.).
• Experience in model compression and quantization techniques.
• Collaborative mindset and strong communication skills.
• Eager to explore new challenges.
• Experience with LLM serving frameworks is a bonus.
• Experience in deep learning inference frameworks is a bonus.

Benefits

• Join a dynamic and multicultural team.
• Work alongside world-class AI talent.
• Enjoy a competitive salary.
• Unlock opportunities for professional growth and learning.