Staff Software Engineer, AI/ML Compute

A global technology company that develops innovative products and services used by billions of users worldwide.
$197,000 - $291,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS · Cloud

Description For Staff Software Engineer, AI/ML Compute

Google is seeking a Staff Software Engineer specializing in AI/ML Compute to join their ML, Systems, & Cloud AI (MSCA) organization. This role is crucial for developing and optimizing machine learning infrastructure that powers Google's services and Google Cloud. The position involves working with cutting-edge AI technologies, including TPUs and Vertex AI platform, while focusing on performance optimization and infrastructure enhancement for AI workloads.

The role requires a blend of deep technical expertise in software development, ML infrastructure, and system architecture, along with leadership capabilities. You'll be working directly with customers and internal teams to benchmark and optimize AI/ML model performance, troubleshoot complex systems, and design specialized ML solutions. The position offers competitive compensation ($197,000-$291,000 base salary) plus additional benefits including bonus and equity.

As part of Google's MSCA organization, you'll be at the forefront of hyperscale computing, working on systems that impact billions of users worldwide through services like Search, YouTube, and Google Cloud. The role provides an opportunity to shape the future of AI infrastructure while working with enterprise customers implementing Gemini models.

This position is perfect for experienced engineers who are passionate about AI/ML systems, have a strong background in software development and architecture, and want to make a significant impact on global-scale infrastructure. The role offers the excitement of working with cutting-edge technology while requiring the ability to collaborate effectively across teams and with customers.

Last updated 8 hours ago

Responsibilities For Staff Software Engineer, AI/ML Compute

  • Partner with customers to benchmark AI/ML model performance on Google Cloud compute
  • Collaborate with internal infrastructure teams to enhance support for AI workloads
  • Conduct performance profiling, debugging, and troubleshooting of training and inference workloads
  • Design and implement specialized ML solutions
  • Up to 10% business-related travel within the US

Requirements For Staff Software Engineer, AI/ML Compute

Python
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 5 years of experience testing, and launching software products
  • 3 years of experience with software design and architecture
  • 3 years of experience with ML infrastructure
  • Experience with data structures/algorithms
  • Experience in technical leadership role
  • Proficiency in cloud services (GCP preferred)

Benefits For Staff Software Engineer, AI/ML Compute

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Bonus
  • Equity
  • Benefits package

Interested in this job?

Jobs Related To Google Staff Software Engineer, AI/ML Compute

Staff Software Engineer, Generative AI, Google Workspace

Staff Software Engineer position at Google focusing on Generative AI and Google Workspace development, requiring expertise in machine learning and AI technologies.

Staff Software Engineer, AI/ML GenAI, Google Ads

Staff Software Engineer position at Google focusing on AI/ML and GenAI technologies for Google Ads, offering competitive compensation and benefits.

Senior Staff Software Engineer, AI/ML GenAI, Google Ads

Senior Staff Software Engineer position at Google focusing on AI/ML and GenAI technologies for Google Ads, offering competitive compensation and benefits.

Field Solutions Developer II, Generative AI, Google Cloud

Senior technical role at Google Cloud focusing on Generative AI development and customer solutions, offering $147K-$216K base salary plus benefits.

Staff Software Engineer, Generative AI, Google Workspace

Staff Software Engineer position at Google focusing on Generative AI development for Google Workspace, offering competitive compensation and opportunity to work on cutting-edge AI technologies.