Senior MLOps Engineer - Remote

Overview

Fortytwo is a decentralized AI protocol on Monad that leverages idle consumer hardware for swarm inference. It enables Small Language Models to achieve advanced multi-step reasoning at lower costs, surpassing the performance and scalability of leading models.

In Short

• Deploy scalable, production-ready ML services with optimized infrastructure and auto-scaling Kubernetes clusters.
• Optimize GPU resources using MIG (Multi-Instance GPU) and NOS (Node Offloading System).
• Manage cloud storage (e.g., S3) to ensure high availability and performance.
• Integrate state-of-the-art ML techniques, such as LoRA and model merging, into workflows.
• Deploy and manage large language models (LLM), small language models (SLM), and large multimodal models (LMM).
• Serve ML models using technologies like Triton Inference Server.
• Set up monitoring and logging solutions using Grafana, Prometheus, Loki, Elasticsearch, and OpenSearch.
• Write and maintain CI/CD pipelines using GitHub Actions for seamless deployment processes.
• Create Helm templates for rapid Kubernetes node deployment.
• Automate workflows using cron jobs and Airflow DAGs.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Proficiency in Kubernetes, Helm, and containerization technologies.
• Experience with GPU optimization (MIG, NOS) and cloud platforms (AWS, GCP, Azure).
• Strong knowledge of monitoring tools (Grafana, Prometheus) and scripting languages (Python, Bash).
• Hands-on experience with CI/CD tools and workflow management systems.
• Familiarity with Triton Inference Server, ONNX, and TensorRT for model serving and optimization.

Benefits

• Engage in meaningful AI research – Work on decentralized inference, multi-agent systems, and efficient model deployment with a team that values rigorous, first-principles thinking.
• Build scalable and sustainable AI – Design AI systems that reduce reliance on massive compute clusters, making advanced models more efficient, accessible, and cost-effective.
• Collaborate with a highly technical team – Join engineers and researchers who are deeply experienced, intellectually curious, and motivated by solving hard problems.