Director, Software Engineering - NIM Factory

NVIDIA is seeking a Director of Software Engineering to lead the development of a GPU accelerated software platform for inference applications. This role is crucial in driving the AI revolution, focusing on optimizing, serving, and measuring the performance of AI models. The ideal candidate will lead a team in building optimized scalable AI services and software products, collaborating with internal and external partners to deliver high-performing inference solutions for all deployment scenarios.

Key Responsibilities:

• Direct the design and implementation of an industry-leading software platform
• Optimize internal software operations using the latest generative AI techniques
• Manage large-scale GPU system deployments
• Collaborate with diverse teams to drive innovation
• Improve development practices across the organization
• Implement performance-focused engineering practices
• Foster continuous feedback loops for AI model and NIM optimization

Requirements:

• Master's or equivalent experience in Computer Science or related field
• Extensive experience in developing software as a service platforms
• Proven success in designing high-performance, cloud-scale APIs
• Strong engineering fundamentals
• 15+ years of hands-on experience delivering software platforms and services
• 5+ years of team leadership and career development experience

The role offers the opportunity to work with cutting-edge GPU technologies, collaborate with top talent in the industry, and contribute to the acceleration of AI model delivery on GPUs. NVIDIA provides a competitive salary range of $308,000 - $471,500 USD, along with equity and comprehensive benefits.