Machine Learning Engineer - d-Matrix Model Factory - Remote

Overview

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

In Short

• Design, build, and optimize machine learning deployment pipelines for large-scale models.
• Implement and enhance model inference frameworks.
• Develop automated workflows for model development, experimentation, and deployment.
• Collaborate with research, architecture, and engineering teams to improve model performance and efficiency.
• Work with distributed computing frameworks (e.g., PyTorch/XLA, JAX, TensorFlow, Ray) to optimize model parallelism and deployment.
• Implement scalable KV caching and memory-efficient inference techniques for transformer-based models.
• Monitor and optimize infrastructure performance across different levels of custom hardware hierarchy.
• Ensure best practices in ML model versioning, evaluation, and monitoring.

Requirements

• Strong programming skills in Python and experience with ML frameworks like PyTorch, TensorFlow, or JAX.
• Hands-on experience with model optimization, quantization, and inference acceleration.
• Deep understanding of Transformer architectures, attention mechanisms, and distributed inference.
• Knowledge of quantization (INT8, BF16, FP16) and memory-efficient inference techniques.
• Solid grasp of software engineering best practices, including CI/CD, containerization (Docker, Kubernetes), and MLOps.
• Strong problem-solving skills and ability to work in a fast-paced, iterative development environment.

Benefits

• Work at the intersection of AI software and custom AI hardware, enabling cutting-edge model acceleration.
• Collaborate with world-class engineers and researchers in a fast-moving AI-driven environment.
• Freedom to experiment, innovate, and build scalable solutions.
• Competitive compensation, benefits, and opportunities for career growth.