Senior AI Software Engineer, GenAI Framework - Remote

Overview

NVIDIA is seeking AI Software Engineers to work on the GenAI Frameworks, focusing on Megatron Core and NeMo Framework, which are designed for researchers and developers involved in Large Language Models and Multimodal foundation model pretraining and post-training.

In Short

• Design and develop the GenAI open source Megatron Core and NeMo Framework.
• Solve large-scale AI training and inference challenges.
• Work on model lifecycle from orchestration to deployment.
• Innovate model architectures and distributed training algorithms.
• Accelerate training with next-gen NVIDIA GPU architectures.
• Performance tuning of deep learning frameworks.
• Research and develop scalable AI tools and pipelines.
• Collaborate with internal partners and the open source community.
• Contribute to improving AI libraries with new innovations.
• Work effectively across multiple engineering initiatives.

Requirements

• MS, PhD or equivalent experience in Computer Science, AI, Applied Math, or related fields.
• 5+ years of industry experience.
• Experience with AI Frameworks (e.g. PyTorch, JAX).
• Proficient in Python programming and software design.
• Strong understanding of AI/Deep-Learning fundamentals.
• Hands-on experience in large-scale AI training.
• Expertise in distributed computing and model parallelism.
• Knowledge of GPU/CPU architecture.
• Contributions to open source deep learning frameworks.
• Demonstrated excellence in performance analysis and tuning.

Benefits

• Work with one of the technology world's most desirable employers.
• Collaborate with forward-thinking and hardworking people.
• Be part of a company that is transforming industries with AI.
• Opportunity for creativity and autonomy in your role.
• Engage in impactful work that affects society.