Staff ETL Engineer - Remote

Overview

We are seeking a senior ML engineer to design and evolve the large-scale offline platform, focusing on building reliable infrastructure for generating training datasets, orchestrating ML workflows, and enabling efficient, distributed model training at scale.

In Short

• Design and operate large-scale data pipelines for ML training.
• Develop infrastructure for distributed training workflows using Pytorch and Ray.
• Integrate ML pipelines with orchestration systems like Flyte or Airflow.
• Improve reproducibility and observability of ML pipelines.
• Optimize performance across distributed compute systems.
• Collaborate with ML engineers for large-scale experimentation.
• Lead architectural improvements for scalable ML pipelines.

Requirements

• Strong experience in building large-scale ML pipelines.
• Experience with distributed computing frameworks like Ray.
• Familiarity with Spark and Flink.
• Experience with training data generation and ML feature pipelines.
• Deep experience in production-grade data pipelines.
• Strong programming skills in Python.
• Experience with modern data infrastructure.
• Strong systems thinking for performance and scalability.
• Proven ability to lead technical direction.

Benefits

• Comprehensive health, life, and disability insurance.
• Commute subsidy.
• Employee stock ownership.
• Competitive retirement/pension plans.
• Generous vacation and personal days.
• Support for new parents through leave and family-care programs.
• Mental Health and Wellbeing programs.
• Training and development programs.
• Volunteering and donation matching program.