Senior Performance Engineer - Deep Learning
Description For Senior Performance Engineer - Deep Learning
NVIDIA is seeking senior software engineers to join their team focused on building and optimizing Deep Learning tools used worldwide. This role offers an opportunity to work with premiere Deep Learning frameworks including PyTorch, JAX, and TensorFlow. As a Senior Performance Engineer, you'll be part of an ambitious team that influences NVIDIA's AI platform development.
The position involves developing and optimizing critical open-source libraries, such as Transformer Engine, which enables fastest training of Large Language Models. You'll work on scaling training systems for huge recommender systems on multiple GPUs and optimize performance of modern Deep Learning models.
The ideal candidate should have strong programming skills in C++ and Python, with experience in parallel programming and GPU computing. Knowledge of Computer Architecture and proven experience with large software projects is essential. Experience with Deep Learning frameworks and language model training is highly valued.
Working at NVIDIA means joining the world leader in accelerated computing, where you'll contribute to transforming major industries through AI and digital twins. The role offers competitive compensation including a base salary range of $184,000-$425,500, plus equity and benefits.
This position provides an excellent opportunity to work with multidisciplinary teams, contribute to open-source communities, and influence the future of AI computing. You'll be at the forefront of developing and optimizing tools that power the world's AI applications.
Responsibilities For Senior Performance Engineer - Deep Learning
- Develop and optimize open-source libraries like Transformer Engine
- Study and tune Deep Learning training workloads at large scale
- Build and support NVIDIA submissions to community benchmarks like MLPerf
- Optimize the performance of influential, modern Deep Learning models
- Explore new technologies and advise design of new hardware generations
Requirements For Senior Performance Engineer - Deep Learning
- BS in Computer Science, Electrical Engineering or a related field (or equivalent experience)
- 6+ years of C++ and Python programming
- Strong background with parallel programming, preferably on GPUs
- Knowledge of Computer Architecture and/or Operating Systems
- Proven experience developing large software projects
- Excellent verbal and written communication skills
Benefits For Senior Performance Engineer - Deep Learning
- Equity
Jobs Related To NVIDIA Senior Performance Engineer - Deep Learning
