Senior Performance Software Engineer, Deep Learning Libraries - Remote

Overview

We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA GPUs.

In Short

• Develop optimized code for deep learning operations on NVIDIA GPUs.
• Write highly tuned compute kernels, mostly in C++ CUDA.
• Follow software engineering best practices including regression testing and CI/CD flows.
• Collaborate with various teams across NVIDIA on optimization tasks.
• Contribute to high-performance code for cuDNN, cuBLAS, and TensorRT libraries.
• Engage in performance-oriented parallel programming.
• Work on deep learning training and inference performance optimization.
• Utilize a solid understanding of computer architecture.
• Participate in developing the underlying software for AI applications.
• Help power breakthroughs in domains like image classification and speech recognition.

Requirements

• PhD or equivalent experience in Computer Science, Computer Engineering, Applied Math, or related field.
• Bachelor's or Master's degree plus 4-6 years of relevant industry experience.
• Strong C++ programming and software design skills.
• Experience with performance-oriented parallel programming (OpenMP or pthreads).
• Solid understanding of computer architecture and assembly programming.
• Experience tuning BLAS or deep learning library kernel code.
• Familiarity with CUDA/OpenCL GPU programming.
• Knowledge of numerical methods and linear algebra.
• Experience with LLVM, TVM tensor expressions, or TensorFlow MLIR is a plus.

Benefits

• Work with a team of forward-thinking and hardworking individuals.
• Be part of a company widely considered a desirable employer in tech.
• Engage in innovative projects in the field of AI and accelerated computing.
• Opportunity for personal and professional growth in a rapidly evolving field.
• Contribute to real-time, cost-effective computing platforms.