Staff Software Engineer, Machine Learning Compilers, Silicon

Google organizes the world's information and makes it universally accessible and useful through AI, Software, and Hardware technologies.
$189,000 - $284,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI

Description For Staff Software Engineer, Machine Learning Compilers, Silicon

Google is seeking a Staff Software Engineer specializing in Machine Learning Compilers to join their EdgeTPU team. This role combines cutting-edge AI technology with hardware optimization, requiring expertise in compiler development and machine learning frameworks. The position offers an opportunity to work on next-generation technologies that impact billions of users worldwide.

The ideal candidate will have extensive experience in software development, particularly with compilers and machine learning systems. You'll be working with advanced ML frameworks like JAX and PyTorch, optimizing them for EdgeTPU deployment. The role involves close collaboration with hardware architects and ML researchers to bridge the gap between research innovations and practical implementations.

Key responsibilities include extending ML authoring frameworks, optimizing model performance, and improving compiler quality. You'll work at the intersection of hardware and software, designing interfaces and co-optimizations between CPU, GPU, and TPU. This position requires both technical depth in compiler development and the ability to collaborate across teams.

The compensation package is highly competitive, ranging from $189,000 to $284,000 base salary, plus bonus, equity, and comprehensive benefits. This role is based in Mountain View, CA, at Google's headquarters, where you'll be part of a team that's pushing the boundaries of AI and hardware acceleration.

Google offers a collaborative environment where you'll work with talented engineers and researchers, contributing to projects that have global impact. The company's commitment to innovation in AI and hardware makes this an exciting opportunity for someone passionate about compiler technology and machine learning optimization.

This role represents a unique opportunity to shape the future of AI hardware acceleration while working with state-of-the-art technology at one of the world's leading tech companies. You'll be at the forefront of developing solutions that make AI more efficient and accessible across Google's product ecosystem.

Last updated 2 months ago

Responsibilities For Staff Software Engineer, Machine Learning Compilers, Silicon

  • Work with and extend Machine Learning (ML) authoring frameworks, including JAX, Pytorch, and gaming ML, to compile ML models for the EdgeTPU
  • Work with ML runtime systems to deploy optimized ML models on the EdgeTPU
  • Work with EdgeTPU architects to design the HW/SW interface, and co-optimizations between CPU, GPU, and TPU
  • Work as part of the EdgeTPU compiler team, including analyzing and improving the compiler quality and performance
  • Collaborate with ML model developers, researchers, and EdgeTPU hardware/software teams

Requirements For Staff Software Engineer, Machine Learning Compilers, Silicon

Python
Java
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development (e.g. C++), and with data structures/algorithms
  • 5 years of experience testing, and launching software products
  • 3 years of experience with software design and architecture
  • 5 years of experience with compilers, such as parallelization, etc.
  • Experience with hardware-software co-design
  • Experience in optimizing Machine Learning (ML) models for inference
  • Experience in Multi-Level Intermediate Representation (MLIR) and low level virtual machines (LLVM)
  • Experience in compiler development within the context of accelerator-based architectures

Benefits For Staff Software Engineer, Machine Learning Compilers, Silicon

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
  • bonus
  • equity
  • benefits

Interested in this job?

Jobs Related To Google Staff Software Engineer, Machine Learning Compilers, Silicon

Senior Technical Program Manager II, Machine Learning, Google Cloud

Senior TPM role at Google Cloud leading machine learning initiatives, managing complex cross-functional projects, and driving strategic planning.

Senior Technical Program Manager I, Machine Learning, Google Cloud Platforms

Senior Technical Program Manager role at Google Cloud, focusing on Machine Learning initiatives with 8+ years of experience required.

Lead Group Product Manager, AI Frameworks

Lead Group Product Manager position at Google Cloud focusing on AI Frameworks, driving adoption and community building for technologies like JAX and PyTorch.

Senior Product Manager, On-Device Machine Learning, Developer Pillar

Senior Product Manager role at Google focusing on On-Device Machine Learning initiatives, requiring 8+ years of experience and offering comprehensive compensation package.

Senior Research Scientist, Google Cloud AI

Senior Research Scientist position at Google Cloud AI, focusing on advanced AI research and development with competitive compensation and benefits.