Senior SRE Engineering Leader – AI Research Clusters

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins to transform industries.
$272,000 - $419,750
Site Reliability
Staff Software Engineer
Hybrid
5,000+ Employees
10+ years of experience
AI · Automotive

Description For Senior SRE Engineering Leader – AI Research Clusters

NVIDIA is leading the way in the AI revolution, revolutionizing industries with our brand-new GPU technology. Our GPUs drive groundbreaking innovations, from self-driving cars to innovative research in computer vision, speech recognition, and more. As "the AI computing company," we constantly push the limits of what can be achieved in AI, big data, and deep learning.

We're seeking bold and visionary leaders to join us on an exciting journey as Senior SRE Engineering Leader. Lead our globally distributed clusters, ensuring seamless operations and delivering AI services that drive breakthroughs in areas such as life sciences and natural language processing.

As SRE Leader, you will build and operate large scale GPU clusters across various cloud providers. You will help design and implement processes, tools and systems that transform this massive operational experience into an overall improvement to the ecosystem. From improving the design of our next gen GPUs, improving our tooling and SW stack, how we build and operate large scale GPU clusters, and the best practices the Industry should follow to get the best value out of our Accelerated Computing Vision.

What you'll be doing:

  • Manage distributed, multi-location GPU clusters for AI research.
  • Lead a team of SREs, driving cluster operational excellence and efficiency.
  • Deliver scalable distributed systems and AI services in fast-paced environments.
  • Build strong, globally distributed teams and drive technical strategy.
  • Collaborate across the company to improve the GPU ecosystem for AI use cases.
  • Solve reliability, efficiency, and productivity challenges for GPU infrastructure.
  • Define strategy, manage projects, and drive technical leadership across multiple areas.
  • Collaborate with internal collaborators to ensure transparency on budget and operational efficiency.

What we need to see:

  • 10+ overall years in engineering management; 3+ in leadership roles.
  • Bachelor's or Master's in Computer Science or a related field, or equivalent experience.
  • Experience supporting AI/ML workloads and driving operational standard methodologies.
  • Strong Unix/Linux knowledge and proficiency in at least two programming languages (Perl, Python, Go).
  • Expertise in managing large-scale distributed systems and AI/HPC environments.
  • Leadership experience, mentoring, and coaching skills.
  • Ability to quickly learn and integrate new technologies.
  • Strong collaboration skills across engineering, server, storage, and security teams.

Ways to stand out from the crowd:

  • Experience with Machine Learning and Deep Learning concepts, algorithms and models.
  • Familiarity with InfiniBand, RDMA, Slurm, LustreFS, BCM.
  • Familiarity with deep learning frameworks like PyTorch and TensorFlow

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most experienced and versatile people in the world working for us and, due to unprecedented growth, our extraordinary engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you.

Last updated 2 months ago

Responsibilities For Senior SRE Engineering Leader – AI Research Clusters

  • Manage distributed GPU clusters for AI research
  • Lead SRE team for operational excellence
  • Deliver scalable distributed systems and AI services
  • Build and lead globally distributed teams
  • Improve GPU ecosystem for AI use cases
  • Solve reliability and efficiency challenges
  • Define strategy and drive technical leadership
  • Ensure budget transparency and operational efficiency

Requirements For Senior SRE Engineering Leader – AI Research Clusters

Linux
Python
Go
  • 10+ years in engineering management
  • 3+ years in leadership roles
  • Bachelor's or Master's in Computer Science or related field
  • Experience with AI/ML workloads
  • Strong Unix/Linux knowledge
  • Proficiency in at least two programming languages (Perl, Python, Go)
  • Expertise in managing large-scale distributed systems
  • Leadership and mentoring skills
  • Ability to learn new technologies quickly
  • Strong collaboration skills

Benefits For Senior SRE Engineering Leader – AI Research Clusters

Equity
  • Competitive salaries
  • Comprehensive benefits package
  • Equity

Interested in this job?

Jobs Related To NVIDIA Senior SRE Engineering Leader – AI Research Clusters

Senior Manager - Storage Production Engineering and SRE

Lead Storage Production Engineering and SRE team at NVIDIA, managing cloud-scale storage solutions and ensuring reliability of GPU cloud services.

Software Engineering Manager II, Site Reliability Engineering, Google Cloud

Lead Site Reliability Engineering team at Google Cloud, managing distributed systems and service reliability while driving technical excellence and team development.

Software Engineering Manager II, Site Reliability Engineering

Lead Google's Site Reliability Engineering team as a Software Engineering Manager II, overseeing system reliability, performance, and team development.

Engineering Manager II, AdsML SRE

Lead Google's AdsML SRE team in Dublin, managing distributed systems and engineering teams while ensuring service reliability and optimization.

Software Engineering Manager, Site Reliability Engineering, FM Store

Lead Site Reliability Engineering team at Google, managing distributed systems and ensuring service reliability while driving technical excellence and team growth.