Staff Software Engineer, Machine Learning Runtime, Google Cloud

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
$189,000 - $284,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Staff Software Engineer, Machine Learning Runtime, Google Cloud

Google is seeking a Staff Software Engineer to join their Machine Learning Runtime team in Google Cloud. This role is part of the Core team, which builds the technical foundation behind Google's flagship products. As a Staff Software Engineer, you'll be at the forefront of developing and optimizing machine learning infrastructure that powers Google's diverse ML ecosystem.

The position offers a compelling opportunity to work on critical projects that impact Google's technical direction across the company. You'll be responsible for leading the design and implementation of specialized ML solutions, managing framework migrations, and optimizing ML infrastructure. The role requires deep expertise in machine learning technologies, particularly in areas such as TensorFlow, JAX, and PyTorch runtimes.

Working at Google means joining a team that builds essential building blocks for excellent, safe, and coherent user experiences while driving innovation for every developer. The Core team has a unique mandate to impact important technical decisions across the company, breaking down technical barriers and strengthening existing systems.

The compensation package is highly competitive, with a base salary range of $189,000-$284,000, plus additional benefits including bonus and equity opportunities. Google offers a comprehensive benefits package and is committed to building a diverse, inclusive workplace where all employees can thrive.

This role is perfect for experienced engineers who are passionate about machine learning infrastructure and want to make a significant impact at scale. You'll work with cutting-edge technologies, lead cross-functional teams, and help shape the future of Google's ML ecosystem. The position requires strong technical leadership skills, extensive experience in ML infrastructure, and the ability to drive complex projects from conception to completion.

If you're excited about solving complex technical challenges, leading high-impact projects, and working with a team that influences Google's technical direction, this role offers an exceptional opportunity to advance your career while making a meaningful contribution to Google's ML infrastructure.

Last updated 3 minutes ago

Responsibilities For Staff Software Engineer, Machine Learning Runtime, Google Cloud

  • Provide technical leadership on high-impact projects
  • Manage project priorities, deadlines, and deliverables
  • Facilitate alignment and clarity across teams on goals, outcomes, and timelines
  • Lead the design and implementation of solutions in specialized ML areas
  • Optimize ML infrastructure and guide development of model optimization
  • Migrate existing frameworks runtimes from TPU to GPU
  • Support Google's diverse ML ecosystem needs

Requirements For Staff Software Engineer, Machine Learning Runtime, Google Cloud

Python
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development, and with data structures/algorithms
  • 5 years of experience testing, and launching software products
  • 3 years of experience with software design and architecture
  • 5 years of experience with speech/audio, reinforcement learning, ML infrastructure, or other ML field
  • 5 years of experience leading ML design and optimizing ML infrastructure

Benefits For Staff Software Engineer, Machine Learning Runtime, Google Cloud

Medical Insurance
Vision Insurance
Dental Insurance
Parental Leave
  • Bonus
  • Equity
  • Benefits package

Interested in this job?

Jobs Related To Google Staff Software Engineer, Machine Learning Runtime, Google Cloud

Senior Staff Software Engineer, Document/Cloud AI

Senior Staff Software Engineer position at Google, focusing on Document/Cloud AI development and leading technical initiatives in machine learning and document processing.

Senior Staff Software Engineer, Machine Learning, Google Ads

Senior Staff Software Engineer position at Google focusing on machine learning applications for Google Ads, offering competitive compensation and opportunity to lead high-impact projects.

Staff Software Engineer, Machine Learning Performance, Cloud Platforms

Lead machine learning performance optimization and system architecture for Google Cloud Platforms, focusing on LLMs and distributed systems.

Staff Software Engineer, Generative AI, Google Cloud AI

Lead and develop cutting-edge Generative AI solutions at Google Cloud, managing technical teams and architecting large-scale machine learning systems.

Staff Software Engineer, Generative AI

Lead Generative AI development at Google Search, combining technical expertise with leadership to shape next-generation search technologies.