Senior Software Architect - Deep Learning and HPC Communications

World leader in accelerated computing, pioneering AI and digital twins technology.
$184,000 - $356,500
Distributed Systems
Staff Software Engineer
Hybrid
5+ years of experience
AI · Enterprise SaaS

Description For Senior Software Architect - Deep Learning and HPC Communications

NVIDIA, the world leader in accelerated computing, is seeking a Senior Software Architect for their GPU Communications Libraries and Networking team. This role focuses on building crucial communication libraries like NCCL, NVSHMEM, and UCX for scaling Deep Learning and HPC. The position involves co-designing next-gen data center platforms and scalable communications software.

The role is central to NVIDIA's work in groundbreaking developments in Artificial Intelligence, High Performance Computing, and Visualization. You'll be working with systems that run at scales of up to tens of thousands of GPUs, connected with high-speed interconnects. Your work will directly impact end-to-end application performance and help break performance barriers in next-generation systems.

The ideal candidate should have strong expertise in C/C++ programming, parallel programming models, and deep understanding of system architecture. Experience with CUDA programming, NVIDIA GPUs, and knowledge of high-performance networks like InfiniBand, RoCE, and NVLink would be advantageous. The role offers competitive compensation, including a base salary range of $184,000 - $356,500 USD, plus equity and benefits.

This is an outstanding opportunity to advance the state-of-the-art in GPU communications and deliver platforms the world has never seen before. You'll be working in a diverse, multi-national environment, contributing to technologies that power everything from artificial intelligence to autonomous cars.

Last updated a month ago

Responsibilities For Senior Software Architect - Deep Learning and HPC Communications

  • Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems
  • Design and implement new communication technologies to accelerate AI and HPC workloads
  • Explore innovative solutions in HW and SW for next generation platforms
  • Build proofs-of-concept, conduct experiments, and perform quantitive modeling
  • Use simulation to explore performance of large GPU clusters

Requirements For Senior Software Architect - Deep Learning and HPC Communications

Linux
Python
  • M.S./Ph.D. degree in CS/CE or equivalent experience
  • 5+ years of relevant experience
  • Excellent C/C++ programming and debugging skills
  • Experience with parallel programming models and communication runtime
  • Deep understanding of operating systems, computer and system architecture
  • Solid fundamentals of network architecture and communication scaling
  • Strong experience with Linux
  • Ability to work and communicate effectively in a multi-national environment

Benefits For Senior Software Architect - Deep Learning and HPC Communications

Equity
  • Equity
  • Comprehensive benefits package

Interested in this job?

Jobs Related To NVIDIA Senior Software Architect - Deep Learning and HPC Communications

Senior Software Architect

Senior Software Architect role at NVIDIA focusing on designing next-generation architecture for DPUs & NICs technologies with emphasis on networking, security, and virtualization.

Senior Software and System Architect

Senior Software and System Architect position at NVIDIA focusing on cloud-networking and security solutions architecture.

Software Engineering Manager, Distributed Task-based Runtimes

Lead NVIDIA's distributed runtime stack development team, focusing on scalable accelerated computing solutions for AI, scientific computing, and data analytics applications.

Senior Engineering Manager, System Integration - Autonomous Vehicles

Senior Engineering Manager role at NVIDIA for System Integration in Autonomous Vehicles, leading a team of 5-10 engineers to deliver new platforms and technologies.

Senior Software Architect, AI Networking

NVIDIA seeks a Senior Software Architect to lead AI data center and network technologies, driving innovation in cloud solutions and representing the company in key industry forums.