Taro Logo

Senior SRE Engineering Leader – AI Research Clusters

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins to transform industries.
$272,000 - $419,750
Site Reliability
Staff Software Engineer
Hybrid
5,000+ Employees
10+ years of experience
AI · Automotive
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Senior SRE Engineering Leader – AI Research Clusters

NVIDIA is leading the way in the AI revolution, revolutionizing industries with our brand-new GPU technology. Our GPUs drive groundbreaking innovations, from self-driving cars to innovative research in computer vision, speech recognition, and more. As "the AI computing company," we constantly push the limits of what can be achieved in AI, big data, and deep learning.

We're seeking bold and visionary leaders to join us on an exciting journey as Senior SRE Engineering Leader. Lead our globally distributed clusters, ensuring seamless operations and delivering AI services that drive breakthroughs in areas such as life sciences and natural language processing.

As SRE Leader, you will build and operate large scale GPU clusters across various cloud providers. You will help design and implement processes, tools and systems that transform this massive operational experience into an overall improvement to the ecosystem. From improving the design of our next gen GPUs, improving our tooling and SW stack, how we build and operate large scale GPU clusters, and the best practices the Industry should follow to get the best value out of our Accelerated Computing Vision.

What you'll be doing:

  • Manage distributed, multi-location GPU clusters for AI research.
  • Lead a team of SREs, driving cluster operational excellence and efficiency.
  • Deliver scalable distributed systems and AI services in fast-paced environments.
  • Build strong, globally distributed teams and drive technical strategy.
  • Collaborate across the company to improve the GPU ecosystem for AI use cases.
  • Solve reliability, efficiency, and productivity challenges for GPU infrastructure.
  • Define strategy, manage projects, and drive technical leadership across multiple areas.
  • Collaborate with internal collaborators to ensure transparency on budget and operational efficiency.

What we need to see:

  • 10+ overall years in engineering management; 3+ in leadership roles.
  • Bachelor's or Master's in Computer Science or a related field, or equivalent experience.
  • Experience supporting AI/ML workloads and driving operational standard methodologies.
  • Strong Unix/Linux knowledge and proficiency in at least two programming languages (Perl, Python, Go).
  • Expertise in managing large-scale distributed systems and AI/HPC environments.
  • Leadership experience, mentoring, and coaching skills.
  • Ability to quickly learn and integrate new technologies.
  • Strong collaboration skills across engineering, server, storage, and security teams.

Ways to stand out from the crowd:

  • Experience with Machine Learning and Deep Learning concepts, algorithms and models.
  • Familiarity with InfiniBand, RDMA, Slurm, LustreFS, BCM.
  • Familiarity with deep learning frameworks like PyTorch and TensorFlow

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most experienced and versatile people in the world working for us and, due to unprecedented growth, our extraordinary engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you.

Last updated 9 months ago

Responsibilities For Senior SRE Engineering Leader – AI Research Clusters

  • Manage distributed GPU clusters for AI research
  • Lead SRE team for operational excellence
  • Deliver scalable distributed systems and AI services
  • Build and lead globally distributed teams
  • Improve GPU ecosystem for AI use cases
  • Solve reliability and efficiency challenges
  • Define strategy and drive technical leadership
  • Ensure budget transparency and operational efficiency

Requirements For Senior SRE Engineering Leader – AI Research Clusters

Linux
Python
Go
  • 10+ years in engineering management
  • 3+ years in leadership roles
  • Bachelor's or Master's in Computer Science or related field
  • Experience with AI/ML workloads
  • Strong Unix/Linux knowledge
  • Proficiency in at least two programming languages (Perl, Python, Go)
  • Expertise in managing large-scale distributed systems
  • Leadership and mentoring skills
  • Ability to learn new technologies quickly
  • Strong collaboration skills

Benefits For Senior SRE Engineering Leader – AI Research Clusters

Equity
  • Competitive salaries
  • Comprehensive benefits package
  • Equity

Interested in this job?