Senior/Staff Machine Learning Engineer - Foundation Models

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market.
$210,000 - $303,000
Machine Learning
Staff Software Engineer
In-Person
5+ years of experience

Description For Senior/Staff Machine Learning Engineer - Foundation Models

Zoox, a pioneering company in the autonomous vehicle industry, is seeking a Senior/Staff Machine Learning Engineer to join their Foundation Models team. This role is part of the Prediction & Behavior ML team, which is responsible for developing machine-learned models that understand the full scene around the vehicle and forecast behavior for other agents, Zoox's own vehicle's actions, and offline applications.

As a Senior/Staff Machine Learning Engineer, you will be at the forefront of building GPT (Generative Pre-Trained) models for autonomous driving and ecosystems for prediction and planning. This position offers an exciting opportunity to push the boundaries of machine learning in the autonomous driving industry by developing state-of-the-art techniques in self-supervised learning, semi-supervised learning, multi-task learning, and generative models.

Your responsibilities will include building foundation models for on-vehicle and offline applications, leveraging large-scale machine learning infrastructure, and developing new algorithms to model the future behavior of all agents in the environment, including Zoox's own vehicles. You will also work on applying generative deep learning to simulation to improve the realism of offline validation systems.

The ideal candidate will have a strong background in Computer Science or a related field, with fluency in PyTorch, TensorFlow, or JAX. Experience with training and deploying Deep Learning models, as well as production Machine Learning pipelines, is essential. Strong programming skills in Python and a basic understanding of C++ are required, along with extensive experience in algorithm design and strong mathematics skills.

Zoox offers a comprehensive compensation package, including a competitive salary range of $210,000 to $303,000, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. The company also provides a wide range of benefits, including health insurance, paid time off, and long-term care insurance.

Join Zoox and be part of a fast-moving, highly execution-oriented team that's revolutionizing urban mobility. This role offers the chance to work at the intersection of robotics, machine learning, and design, contributing to the development of the next generation of mobility-as-a-service in urban environments.

Last updated 5 months ago

Responsibilities For Senior/Staff Machine Learning Engineer - Foundation Models

  • Build foundation models for on-vehicle and offline applications
  • Develop state-of-the-art techniques in self-supervised learning, semi-supervised learning, multi-task learning, and generative models
  • Leverage large-scale machine learning infrastructure to discover new solutions
  • Develop algorithms to model future behavior of all agents in the world
  • Develop algorithms to model future behavior of our own vehicle's actions
  • Develop algorithms to apply generative deep learning to simulation
  • Engineer software that runs on-vehicle to efficiently execute algorithms in real time
  • Develop metrics and tools to analyze errors and understand improvements
  • Collaborate with engineers on Perception, Prediction, Planning, Simulation, and Systems Engineering

Requirements For Senior/Staff Machine Learning Engineer - Foundation Models

Python
  • BS, MS, or PhD degree in Computer Science or a related field
  • Fluency with PyTorch, TensorFlow, or JAX
  • Experience with training and deploying Deep Learning models
  • Experience with production Machine Learning pipelines
  • Fluency in Python and a basic understanding of C++
  • Extensive experience with programming and algorithm design
  • Strong mathematics skills

Benefits For Senior/Staff Machine Learning Engineer - Foundation Models

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
  • Paid time off (sick leave, vacation, bereavement)
  • Unpaid time off
  • Zoox Stock Appreciation Rights
  • Amazon RSUs
  • Health insurance
  • Long-term care insurance
  • Long-term and short-term disability insurance
  • Life insurance

Interested in this job?

Jobs Related To Zoox Senior/Staff Machine Learning Engineer - Foundation Models

Senior/Staff Software Engineer - Scene Understanding

Senior/Staff Software Engineer position at Zoox focusing on autonomous vehicle scene understanding, combining ML and robotics expertise.

Senior/Staff Machine Learning Engineer, Agent Simulation

Senior/Staff Machine Learning Engineer role at Zoox, focusing on agent simulation for autonomous vehicles. Hybrid work in San Francisco Bay Area.

Senior/Staff Machine Learning Engineer - Prediction & Behavior ML

Senior/Staff Machine Learning Engineer role at Zoox, developing cutting-edge algorithms for autonomous vehicle behavior prediction and planning.

Senior/Staff Machine Learning Engineer, 3D Simulation

Senior/Staff Machine Learning Engineer for 3D Simulation at Zoox, working on cutting-edge 3D vision and simulation technologies for autonomous vehicles.

AIML - Developer Experience Engineering Manager, Machine Learning Platform & Infrastructure

Lead Apple's Developer Experience engineering team for ML Platform & Infrastructure, managing platform development and optimization for search and foundation models.