Senior Software Architect - Deep Learning and HPC Communications

World leader in accelerated computing, pioneering AI and digital twins technology.
$180,000 - $339,250
Distributed Systems
Principal Software Engineer
Hybrid
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Senior Software Architect - Deep Learning and HPC Communications

NVIDIA, the pioneer in GPU technology and leader in AI and High Performance Computing, is seeking a Senior Software Architect for their GPU Communications Libraries and Networking team. This role focuses on building crucial communication libraries like NCCL, NVSHMEM, and UCX for scaling Deep Learning and HPC applications. The position involves working with systems that scale to thousands of GPUs, utilizing high-speed interconnects like NVLink and InfiniBand. The ideal candidate will help co-design next-generation data center platforms and develop scalable communications software. This is an opportunity to work at the cutting edge of AI and HPC, breaking performance barriers and developing revolutionary technologies. The role combines deep technical expertise in distributed systems, networking, and GPU architecture with the chance to influence the future of AI and HPC computing. NVIDIA offers competitive compensation, including equity, and the chance to work with world-class experts in a collaborative, multi-national environment.

Last updated 18 days ago

Responsibilities For Senior Software Architect - Deep Learning and HPC Communications

  • Investigate opportunities to improve communication performance
  • Design and implement new communication technologies
  • Explore innovative solutions in HW and SW for next generation platforms
  • Build proofs-of-concept and conduct experiments
  • Use simulation to explore performance of large GPU clusters

Requirements For Senior Software Architect - Deep Learning and HPC Communications

Linux
Python
  • M.S./Ph.D. degree in CS/CE or equivalent experience
  • 5+ years of relevant experience
  • Excellent C/C++ programming and debugging skills
  • Experience with parallel programming models (MPI, SHMEM)
  • Deep understanding of operating systems, computer and system architecture
  • Solid fundamentals of network architecture and topology
  • Strong experience with Linux
  • Ability to work in multi-national, multi-time-zone environment

Benefits For Senior Software Architect - Deep Learning and HPC Communications

Equity
  • Equity

Interested in this job?

Jobs Related To NVIDIA Senior Software Architect - Deep Learning and HPC Communications

Senior Software Architect, Accelerated Computing

Senior Software Architect position at NVIDIA focusing on AI Cloud architecture and HPC networks, offering competitive salary and opportunity to work with cutting-edge technology.

Software Engineering Manager - GPU Communications Libraries

Lead the GPU Communications Libraries team at NVIDIA, managing NVSHMEM and UCX libraries for Deep Learning and HPC applications.

Senior Software Architect, Advanced Development

NVIDIA seeks a Senior Software Architect for Advanced Development to design innovative solutions in network programmability and data center technologies.

Principal Software Engineer - Autonomous Vehicles

Principal Software Engineer role for Autonomous Vehicles at NVIDIA, focusing on 3D world modeling and fusion of perception and mapping signals.

Senior Software Architect, AI and HPC

NVIDIA seeks a Senior Software Architect for AI and HPC to innovate in parallel programming, network architecture, and hardware development.