Research Engineer - Large Behavior Models, Computer Vision
Description For Research Engineer - Large Behavior Models, Computer Vision
Toyota Research Institute (TRI) is at the forefront of revolutionizing robotics through advanced machine learning and AI. We're developing general-purpose robots that can assist with household tasks, elder care, and various daily activities. Our mission focuses on creating robots that can operate reliably in unstructured environments with minimal supervision.
The role of Research Engineer for Large Behavior Models and Computer Vision offers an exciting opportunity to work with cutting-edge technology in robotics and AI. You'll be part of a cross-functional team with expertise in simulation, perception, controls, language, vision, and multimodal learning. The position involves working with a fleet of robots and developing large-scale foundation models that combine multiple modalities including language, video, audio, and physical interaction data.
As a team member, you'll collaborate with top academic institutions like MIT, Stanford, and Berkeley, while building and improving end-to-end ML pipelines. The role requires expertise in PyTorch and distributed training techniques, with a focus on both rapid prototyping and robust implementation. You'll be instrumental in advancing robot capabilities through fundamental technological development.
The position offers competitive compensation ($165,760-$238,280/year for California-based roles) and comprehensive benefits including 401(k), paid time off, and annual bonuses. TRI values diversity and inclusion, fostering an innovative and collaborative environment where different perspectives are welcomed and celebrated. Join us in making general-purpose robots a reality and contributing to groundbreaking research that will shape the future of robotics and AI.
Responsibilities For Research Engineer - Large Behavior Models, Computer Vision
- Collaborate with internal research scientists and partner labs at top academic research universities
- Build, improve, and robustify end-to-end integrated ML pipelines for training multimodal models
- Train, finetune, and serve robot foundation models with MLOps mindset
- Build processes for integrating collaboration-produced and open-source code
- Build and improve large data pipelines for foundation model training
- Play a critical role in rapid progress for internal capabilities and external publications
Requirements For Research Engineer - Large Behavior Models, Computer Vision
- 2+ years of professional ML engineering experience at an AI/ML-focused organization
- Familiarity with state-of-the-art in behavior learning, language, and/or computer vision
- Experience training large-scale foundation models
- Extensive practical experience with PyTorch
- Strong proficiency in Python and software development best practices
- Familiarity with data pipelines, model serving and optimization, cloud training, and dataset management
- Ability to move fast and switch between rapid prototyping and robust implementation
Benefits For Research Engineer - Large Behavior Models, Computer Vision
- 401(k) eligibility
- Paid time off benefits
- Vacation
- Sick time
- Parental leave
- Annual cash bonus structure
