Senior Software Engineer, NIM Production

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology.
$180,000 - $339,250
Backend
Senior Software Engineer
In-Person
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer, NIM Production

NVIDIA, the world leader in accelerated computing, is seeking a Senior Software Engineer for their NVIDIA Inference Microservices (NIMs) team. This role focuses on developing components for software factory automation and deployed services that power AI-driven applications. The position offers an opportunity to work with cutting-edge technology, developing highly available services that utilize thousands of GPUs.

The role involves designing and optimizing containerized inference execution systems, working with technologies like Docker, Kubernetes, and cloud platforms. You'll be responsible for driving the adoption of optimized models through microservices developed in Python or Go, ensuring top-tier performance and scalability. The position requires deep technical expertise in distributed systems and container technologies, with opportunities to influence the development of many models and products within NVIDIA.

As a senior engineer, you'll collaborate with a diverse team of software engineers, researchers, SREs, and product managers, while also taking on mentorship responsibilities. The ideal candidate brings 6+ years of experience in microservices development, strong technical skills in container technologies, and excellent interpersonal abilities. The role offers competitive compensation, including a base salary range of $180,000-$339,250, plus equity and benefits.

This is an excellent opportunity for experienced engineers passionate about AI infrastructure and distributed systems to join a company at the forefront of technological innovation. NVIDIA's commitment to fostering a diverse work environment and its position as one of technology's most desirable employers makes this an attractive opportunity for those looking to make a significant impact in the AI and computing industry.

Last updated 19 days ago

Responsibilities For Senior Software Engineer, NIM Production

  • Design, build, and optimize containerized inference execution for various applications
  • Drive adoption of optimized models through microservices developed in Python or Go
  • Ensure performance and scalability of NIMs through comprehensive measurement and optimization
  • Create and optimize basic building blocks of NIMs
  • Collaborate with software engineers, researchers, SREs, and product management
  • Mentor and collaborate with team members

Requirements For Senior Software Engineer, NIM Production

Kubernetes
Python
Go
  • Advanced programming skills in building distributed compute systems and backend services
  • Experience working with multi-functional teams across organizational boundaries
  • Deep technical expertise in containerized applications using Docker, Kubernetes, Cloud Endpoints, Helm, and Prometheus
  • Experience debugging and analyzing performance of distributed microservices
  • BS or MS in Computer Science, Computer Engineering, or related field
  • 6+ years of experience in developing performant microservices
  • Excellent interpersonal skills

Benefits For Senior Software Engineer, NIM Production

Equity
  • Equity
  • Benefits package offered

Interested in this job?

Jobs Related To NVIDIA Senior Software Engineer, NIM Production

Senior Software Engineer - Data Center Rack and Power Management Engineering

Senior Software Engineer position at NVIDIA focusing on data center rack and power management engineering for AI infrastructure.

Senior HPC Performance Engineer

Senior HPC Performance Engineer role at NVIDIA focusing on optimizing GPU communication libraries for large-scale deep learning and HPC applications.

Senior Software QA Engineer

Senior Software QA Engineer position at NVIDIA, focusing on technical support, debugging, and quality assurance for cutting-edge GPU and AI technologies.

Senior Software Test Development Engineer

Senior Software Test Development Engineer role at NVIDIA, leading test framework development for networking and interconnect products with 12+ years experience required.

Senior Compiler Engineer - AI

Senior Compiler Engineer position at NVIDIA focusing on AI compiler development and optimization for GPU architectures.