GPU Engineer - Remote

Overview

We are seeking an experienced GPU Engineer with a strong background in Python and large-scale model training. In this role you will design and implement improvements to our large scale training infrastructure and directly help make technical decisions to optimise our models' training performance and efficiency.

In Short

• Strong engineering skills with fluency in Python and PyTorch or other acceleration libraries.
• Experience writing and debugging low-level GPU code (CUDA, Triton) and debugging hardware errors.
• Experienced in scaling up GPU jobs via large-scale compute clusters using Slurm or Kubernetes.
• Preferred: knowledge of advanced filesystems, particularly Ceph, and their integration and optimization in large systems.
• Preferred: proficient in implementing robust monitoring systems for performance tracking and anomaly detection.

Requirements

• Strong engineering skills with fluency in Python and PyTorch or other acceleration libraries.
• Experience writing and debugging low-level GPU code (CUDA, Triton) and debugging hardware errors.
• Experienced in scaling up GPU jobs via large-scale compute clusters using Slurm or Kubernetes.
• Preferred: knowledge of advanced filesystems, particularly Ceph, and their integration and optimization in large systems.
• Preferred: proficient in implementing robust monitoring systems for performance tracking and anomaly detection.

Benefits

• An Elite Team: Collaborate with top-tier engineers, researchers, operators from renowned organizations like Google DeepMind and Facebook AI Research (FAIR) and successful startups, driving innovation in cutting-edge AI technology.
• Massive Market Opportunity: Be part of a rapidly growing industry poised to transform multiple sectors globally, offering the chance to make a significant impact.
• Mission-Driven Environment: Work alongside a collaborative, mission-focused team dedicated to advancing AI for meaningful applications.
• Inclusive and Open Culture: Thrive in an open and inclusive work environment that values diverse perspectives and fosters creativity.
• Generous Benefits: Enjoy 5 weeks of paid leave to recharge, comprehensive healthcare benefits including vision and dental, and additional perks that support your well-being.
• Visa Support: We provide visa assistance, including H1B and OPT transfers, for US employees to ensure a smooth transition and support your career with us.