Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex

Google builds technical foundation for ML/AI offerings and cloud computing, managing infrastructure and platforms for all Google products.
$349,000 - $485,000
Machine Learning
Principal Software Engineer
In-Person
5,000+ Employees
18+ years of experience
AI · Enterprise SaaS · Cloud

Description For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex

Google's ML, Systems and Cloud AI (MSCA) organization is seeking a Distinguished Engineer to lead GPU optimization and infrastructure development. This role combines deep technical expertise in GPU architecture and ML systems with strategic leadership responsibilities. The position involves working with Core ML, Google's central machine learning platform team, to drive ML excellence across Google's product portfolio including Search, Ads, Youtube, Cloud, and Maps.

The role requires extensive experience (18+ years) in GPU performance optimization and large-scale infrastructure systems. The successful candidate will evaluate upcoming hardware technologies, optimize ML models for performance, and work closely with both cloud and internal customers. They will play a crucial role in bridging TPU and GPU technologies while creating robust infrastructure for ML systems access.

This is a unique opportunity to impact Google's ML infrastructure at scale, working with cutting-edge technologies including Gemini models. The position offers competitive compensation ($349,000-$485,000 base salary) plus bonus, equity, and comprehensive benefits. The ideal candidate will combine technical depth in GPU architectures and ML optimization with strong leadership and communication skills.

The role is based in Sunnyvale, CA, and offers the chance to work with Google Cloud, which serves customers in over 200 countries. This position is perfect for someone passionate about advancing ML technology while solving critical business challenges at a global scale.

Last updated 15 hours ago

Responsibilities For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex

  • Lead efforts to optimize machine learning models for speed, memory efficiency, and accuracy
  • Translate customer requirements into technical solutions
  • Guide and inspire junior engineers by leading by example
  • Identify bottlenecks and areas for improvement
  • Influence architecture of Google's internal and external software architecture

Requirements For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex

  • Bachelor's degree in Computer Science, a similar field, or equivalent practical experience
  • 18 years of experience working with GPU inference optimization
  • 18 years of experience in GPU performance related work
  • Experience designing and developing large-scale infrastructure systems
  • GPU Inference optimization experience
  • Deep understanding of modern GPU architectures memory hierarchies, and performance bottlenecks
  • Ability to develop and utilize sophisticated performance models and benchmarks
  • Excellent communication and people skills
  • Expertise in tailoring algorithms and ML models to exploit GPU strengths

Benefits For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex

Medical Insurance
Dental Insurance
Vision Insurance
  • bonus
  • equity
  • benefits

Interested in this job?

Jobs Related To Google Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex

Senior Product Manager, Local Data Contributor Success

Senior Product Manager position at Google focusing on Local Data Contributor Success, requiring 8 years of product management experience and expertise in technical product development.

Lead Group Product Manager, AI Frameworks

Lead Google Cloud's AI frameworks adoption strategy, develop developer communities, and establish thought leadership in AI/ML space while managing product evangelism initiatives.

Senior Technical Program Manager, Semantic Perception

Senior Technical Program Manager position at Google, leading semantic perception initiatives in AR/XR and immersive computing technologies.

Group Product Manager, Machine Learning Frameworks Applied Ecosystem

Lead product management for Google's Machine Learning Frameworks, focusing on Keras and collaborating across internal and external AI ecosystems.

Silicon AI/ML Architect, TPU, Google Cloud

Lead the architecture development of AI/ML SoCs for Google Cloud's TPU, focusing on high-performance computing and machine learning acceleration.