Senior/Staff Machine Learning Engineer - Foundation Models

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market.
$210,000 - $303,000
Machine Learning
Staff Software Engineer
In-Person
5+ years of experience

Description For Senior/Staff Machine Learning Engineer - Foundation Models

Zoox, a pioneering company in the autonomous vehicle industry, is seeking a Senior/Staff Machine Learning Engineer to join their Foundation Models team. This role is part of the Prediction & Behavior ML team, which is responsible for developing machine-learned models that understand the full scene around the vehicle and forecast behavior for other agents, Zoox's own vehicle's actions, and offline applications.

As a Senior/Staff Machine Learning Engineer, you will be at the forefront of building GPT (Generative Pre-Trained) models for autonomous driving and ecosystems for prediction and planning. This position offers an exciting opportunity to push the boundaries of machine learning in the autonomous driving industry by developing state-of-the-art techniques in self-supervised learning, semi-supervised learning, multi-task learning, and generative models.

Your responsibilities will include building foundation models for on-vehicle and offline applications, leveraging large-scale machine learning infrastructure, and developing new algorithms to model the future behavior of all agents in the environment, including Zoox's own vehicles. You will also work on applying generative deep learning to simulation to improve the realism of offline validation systems.

The ideal candidate will have a strong background in Computer Science or a related field, with fluency in PyTorch, TensorFlow, or JAX. Experience with training and deploying Deep Learning models, as well as production Machine Learning pipelines, is essential. Strong programming skills in Python and a basic understanding of C++ are required, along with extensive experience in algorithm design and strong mathematics skills.

Zoox offers a comprehensive compensation package, including a competitive salary range of $210,000 to $303,000, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. The company also provides a wide range of benefits, including health insurance, paid time off, and long-term care insurance.

Join Zoox and be part of a fast-moving, highly execution-oriented team that's revolutionizing urban mobility. This role offers the chance to work at the intersection of robotics, machine learning, and design, contributing to the development of the next generation of mobility-as-a-service in urban environments.

Last updated 4 months ago

Responsibilities For Senior/Staff Machine Learning Engineer - Foundation Models

  • Build foundation models for on-vehicle and offline applications
  • Develop state-of-the-art techniques in self-supervised learning, semi-supervised learning, multi-task learning, and generative models
  • Leverage large-scale machine learning infrastructure to discover new solutions
  • Develop algorithms to model future behavior of all agents in the world
  • Develop algorithms to model future behavior of our own vehicle's actions
  • Develop algorithms to apply generative deep learning to simulation
  • Engineer software that runs on-vehicle to efficiently execute algorithms in real time
  • Develop metrics and tools to analyze errors and understand improvements
  • Collaborate with engineers on Perception, Prediction, Planning, Simulation, and Systems Engineering

Requirements For Senior/Staff Machine Learning Engineer - Foundation Models

Python
  • BS, MS, or PhD degree in Computer Science or a related field
  • Fluency with PyTorch, TensorFlow, or JAX
  • Experience with training and deploying Deep Learning models
  • Experience with production Machine Learning pipelines
  • Fluency in Python and a basic understanding of C++
  • Extensive experience with programming and algorithm design
  • Strong mathematics skills

Benefits For Senior/Staff Machine Learning Engineer - Foundation Models

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
  • Paid time off (sick leave, vacation, bereavement)
  • Unpaid time off
  • Zoox Stock Appreciation Rights
  • Amazon RSUs
  • Health insurance
  • Long-term care insurance
  • Long-term and short-term disability insurance
  • Life insurance

Interested in this job?

Jobs Related To Zoox Senior/Staff Machine Learning Engineer - Foundation Models

Senior/Staff Machine Learning Engineer, Agent Simulation

Senior/Staff Machine Learning Engineer role at Zoox, focusing on agent simulation for autonomous vehicles. Hybrid work in San Francisco Bay Area.

Senior/Staff Machine Learning Engineer - Prediction & Behavior ML

Senior/Staff Machine Learning Engineer role at Zoox, developing cutting-edge algorithms for autonomous vehicle behavior prediction and planning.

Senior/Staff Perception Machine Learning Engineer - 3D Tracking

Senior/Staff ML Engineer role at Zoox, focusing on 3D Tracking for autonomous vehicles. 7+ years exp, C++/Python skills, competitive pay $180k-$303k.

Senior/Staff Machine Learning Engineer, 3D Simulation

Senior/Staff Machine Learning Engineer for 3D Simulation at Zoox, working on cutting-edge 3D vision and simulation technologies for autonomous vehicles.

Manager, LLM Accuracy Evaluation

Lead a team developing evaluation methodologies for LLMs and deep learning models at NVIDIA, driving innovation in AI model performance assessment.