Senior Software Engineer-Distributed Inference

NVIDIA is seeking a Senior Software Engineer to join their GPU-accelerated deep learning software team, focusing on the Triton Inference Server. This role combines distributed systems expertise with cutting-edge AI technology, working on performance analysis and optimization of large language models and deep learning systems. The position offers the opportunity to work with NVIDIA's industry-leading GPU technology and contribute to tools that make deep learning more accessible to data scientists worldwide.

The role involves developing and enhancing performance analysis tools, collaborating with researchers and engineers, and implementing efficient algorithms for measuring deep learning throughput and latency. You'll be working in a remote-friendly environment, contributing to NVIDIA's mission of transforming computing through AI innovation.

The ideal candidate will bring 8+ years of experience in computer science or related fields, strong Python programming skills, and knowledge of distributed systems. Experience with deep learning frameworks, cloud platforms, and NVIDIA GPUs is highly valued. This position offers competitive compensation, including a base salary range of $184,000 - $356,500, plus equity and benefits.

NVIDIA's legacy of innovation spans over 25 years in computer graphics, PC gaming, and accelerated computing. The company is at the forefront of AI computing, defining the next era where GPUs power computers, robots, and self-driving cars. This role presents an exciting opportunity to make a lasting impact in the field of AI and deep learning while working with some of the industry's best talent in a diverse and supportive environment.