Staff Software Engineer, Scaling On-Device ML Frameworks

Google is a global technology company that develops cloud computing, search, software, and online advertising technologies.
Machine Learning
Staff Software Engineer
Contact Company
8+ years of experience
AI

Description For Staff Software Engineer, Scaling On-Device ML Frameworks

Google is seeking a Staff Software Engineer to lead the development of on-device Machine Learning frameworks, with a focus on scaling and improving their functionality, particularly in the era of Generative AI. This role is central to Google's product portfolio, working on technologies that power unique experiences on Pixel and Android devices, such as Speech Recognition, Camera, and Assistant/Translation.

The position requires a seasoned professional with extensive experience in mobile application development and strong programming skills in languages like C++, Java, and Python. You'll be working with cutting-edge ML frameworks like TensorFlow Lite and MediaPipe, and integrating popular libraries such as Hugging Face, JAX, and PyTorch.

As a Staff Software Engineer, you'll be responsible for developing and scaling partnerships with Android Apps and Google Cloud Customers, creating sample applications that demonstrate best practices in hardware acceleration and optimization, and implementing automated processes for testing APIs across diverse platforms. You'll be at the forefront of on-device ML deployment, working with state-of-the-art models and ensuring excellent user experiences.

The role offers the opportunity to work with Google Cloud's next-generation technologies that impact billions of users worldwide. You'll be part of a team that's pushing the boundaries of what's possible in on-device machine learning, especially as Google moves towards a future with personalized Generative AI experiences on devices.

This position is ideal for someone who combines technical expertise in mobile development and machine learning with a vision for creating scalable, efficient frameworks. You'll have the chance to influence the direction of Google's on-device ML capabilities while working with some of the most advanced technology in the field. The role offers the opportunity to work on critical projects with the flexibility to grow and evolve alongside Google's fast-paced business.

Last updated a day ago

Responsibilities For Staff Software Engineer, Scaling On-Device ML Frameworks

  • Ramp to our frameworks in the form of E2E integrations between popular Hugging Face/JAX/PyTorch libraries and AI Edge Torch, MP LLM Inference API
  • Create sample apps demonstrating best practices including hardware accelerations, quantization, debugging and optimizing performance and quality
  • Onboard SOTA models to provide excellent self-serve out-of-the-box experience for users
  • Scale partnerships with Android Apps and Google Cloud Customers and drive improvements in the overall stack based on real customer needs
  • Define and implement automated processes and infrastructure to test APIs and user-journeys across diverse platforms and advocate for product excellence

Requirements For Staff Software Engineer, Scaling On-Device ML Frameworks

Python
Java
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in mobile application development or Android framework development
  • 5 years of coding experience in C, C++, Java, or Python
  • Experience with frameworks such as JAX, and PyTorch (preferred)
  • Full-stack Android, iOS, and Web development experience (preferred)
  • OSS development experience (preferred)
  • Experience in on-device machine learning deployment (preferred)
  • Experience with Machine Learning infrastructure, Mobile App Development, and Integration Testing (preferred)
  • Experience with iOS Development, Android Development, C++, and Python (preferred)

Interested in this job?

Jobs Related To Google Staff Software Engineer, Scaling On-Device ML Frameworks

Machine Learning Engineer

Senior Machine Learning Engineer role at Apple focusing on compiler development for Neural Engine Accelerator architecture, offering competitive compensation and benefits.

AIML - Cloud Infra Engineering Manager, Machine Learning Platform & Infrastructure

Lead Apple's ML infrastructure team building scalable cloud solutions for AI-powered search systems, managing engineering teams and driving technical innovation.

ML Engineer L5 - Ads Platform Engineering (Forecasting)

Senior ML Engineer position at Netflix focusing on ads platform engineering and forecasting, building scalable ad tech solutions.

Manager II, Generative AI

Lead Uber's Generative AI initiatives as Manager II, overseeing development of AI-powered customer support solutions and managing a team of ML engineers.

AI NPU Compute Apps - Product Manager Senior

Senior Product Manager role leading AI NPU compute apps strategy and development at Qualcomm, focusing on breakthrough AI experiences and LLM optimization.