Principal Engineer, GPUs, Core ML, Borg, Spatial Flex

Google Cloud provides enterprise-grade solutions leveraging cutting-edge technology, helping organizations digitally transform across 200+ countries.
$294,000 - $414,000
Machine Learning
Principal Software Engineer
In-Person
5,000+ Employees
15+ years of experience
AI · Enterprise SaaS · Cloud

Description For Principal Engineer, GPUs, Core ML, Borg, Spatial Flex

Google's Core ML team is seeking a Principal Engineer to lead GPU technology evaluation and optimization initiatives. This role combines deep technical expertise in GPU architecture with strategic leadership in machine learning infrastructure. The position involves optimizing ML models for state-of-the-art performance on GPUs, working closely with both cloud and internal customers, and creating robust infrastructure for ML systems access.

The role requires extensive experience (15+ years) in GPU performance optimization and inference work. The successful candidate will evaluate upcoming hardware technologies, advocate for GPU use-cases, and bridge the gap between TPU and GPU offerings. They will lead efforts to achieve industry-leading performance for key models through both traditional optimization techniques and automated infrastructure development.

As part of Google Cloud, which serves customers in over 200 countries, this position offers the opportunity to impact global digital transformation initiatives. The role comes with competitive compensation ($294,000-$414,000 base salary) plus additional benefits including bonus and equity packages.

The ideal candidate will combine technical depth in GPU architectures and ML optimization with strong leadership and communication skills. They will guide junior engineers, work directly with customers, and drive strategic technical decisions. This is an opportunity to shape the future of ML infrastructure at one of the world's leading technology companies while working with cutting-edge hardware and software technologies.

Last updated 11 hours ago

Responsibilities For Principal Engineer, GPUs, Core ML, Borg, Spatial Flex

  • Provide engineering leadership and strategic product vision in Cloud and internal use cases
  • Lead efforts to optimize machine learning models for speed, memory efficiency, and accuracy
  • Translate customer requirements into technical solutions
  • Guide and inspire junior engineers by leading by example
  • Identify bottlenecks and develop performance analysis tools

Requirements For Principal Engineer, GPUs, Core ML, Borg, Spatial Flex

Python
  • Bachelor's degree in Computer Science, a similar field, or equivalent practical experience
  • 15 years of experience in GPU performance related work
  • 15 years of experience working with GPU Inference optimization
  • Deep understanding of modern GPU architectures memory hierarchies, and performance bottlenecks
  • Ability to develop and utilize sophisticated performance models and benchmarks
  • Excellent communication and people skills
  • Expertise in tailoring algorithms and ML models to exploit GPU strengths

Benefits For Principal Engineer, GPUs, Core ML, Borg, Spatial Flex

Medical Insurance
Dental Insurance
Vision Insurance
  • Bonus
  • Equity
  • Benefits package

Interested in this job?

Jobs Related To Google Principal Engineer, GPUs, Core ML, Borg, Spatial Flex

Senior Product Manager, Local Data Contributor Success

Senior Product Manager position at Google focusing on Local Data Contributor Success, requiring 8 years of product management experience and expertise in technical product development.

Lead Group Product Manager, AI Frameworks

Lead Google Cloud's AI frameworks adoption strategy, develop developer communities, and establish thought leadership in AI/ML space while managing product evangelism initiatives.

Senior Technical Program Manager, Semantic Perception

Senior Technical Program Manager position at Google, leading semantic perception initiatives in AR/XR and immersive computing technologies.

Group Product Manager, Machine Learning Frameworks Applied Ecosystem

Lead product management for Google's Machine Learning Frameworks, focusing on Keras and collaborating across internal and external AI ecosystems.

Silicon AI/ML Architect, TPU, Google Cloud

Lead the architecture development of AI/ML SoCs for Google Cloud's TPU, focusing on high-performance computing and machine learning acceleration.