Senior ML Acceleration Engineer

Stack develops revolutionary AI and advanced autonomous systems for enhancing safety, reliability, and efficiency in the trucking transportation industry.
Machine Learning
Senior Software Engineer
Contact Company
5+ years of experience
AI · Automotive

Description For Senior ML Acceleration Engineer

Stack is at the forefront of developing revolutionary AI and advanced autonomous systems for the trucking transportation industry. Our technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies to create innovative solutions that enhance safety, reliability, and efficiency of modern operations.

We are seeking an experienced and hands-on engineer for our ML acceleration team within the training and deployment team, part of the ML Platform org at Stack AV. This role is crucial in developing and optimizing the platform that enables our AI team to build, optimize, test, and deploy models on autonomous vehicles.

As an ML Acceleration Engineer, you will be responsible for analyzing and profiling ML models, implementing optimizations using CUDA, Triton, and custom kernels, and automating the process of exporting models to optimized formats like TensorRT. You'll work closely with ML researchers to balance model accuracy and speed, and collaborate with cross-functional teams to understand data requirements and design appropriate solutions.

The ideal candidate will have a deep understanding of GPUs and optimization, excellent collaboration skills, and the ability to drive technical excellence. This role offers an opportunity to work with cutting-edge technologies in the autonomous vehicle industry and make a significant impact on the future of transportation.

Join Stack and be part of a team dedicated to creating an autonomous solution ecosystem tailored to the unique demands of the trucking industry. We offer a diverse and inclusive work environment that values entrepreneurship and innovation across all backgrounds and identities.

Note: This position may be subject to U.S. national security-related requirements and export control regulations. Candidates may need to meet specific residence, U.S. person status, and/or citizenship criteria.

Last updated 5 months ago

Responsibilities For Senior ML Acceleration Engineer

  • Analyze and profile ML models to identify performance bottlenecks
  • Use OSS tooling to enhance platform for ML engineers to profile and optimize models
  • Automate process of exporting models to optimized format and deploying them
  • Implement optimizations using CUDA, Triton, and custom kernels
  • Collaborate with ML researchers to balance model accuracy and speed
  • Develop efficient model export, optimization, and profiling solutions
  • Collaborate with cross-functional teams to understand data requirements and design solutions
  • Stay updated with latest technologies in ML inference and ML accelerators
  • Identify and resolve performance bottlenecks in models
  • Promote and maintain engineering excellence within the team

Requirements For Senior ML Acceleration Engineer

Python
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field
  • 5+ years of experience (including experience with GPU programming and optimization)
  • Strong programming skills in C++ and Python
  • Proven experience in GPU programming and optimization
  • Familiarity with deep learning frameworks, especially PyTorch
  • CUDA programming
  • Triton language for GPU kernels
  • PyTorch optimization techniques
  • TensorRT implementation
  • ONNX model conversion and deployment
  • Custom GPU kernel development
  • Strong analytical and problem-solving skills
  • Excellent verbal and written communication skills

Interested in this job?

Jobs Related To Stack Senior ML Acceleration Engineer

Software Engineer III - ML, Python

Senior Software Engineer role at JPMorgan Chase focusing on ML fraud prevention platform development, offering competitive salary and comprehensive benefits.

AI/ML Engineer III

Senior AI/ML Engineer role at JPMorgan Chase focusing on AWS Cloud, ML platforms, and Gen AI solutions, offering competitive compensation and comprehensive benefits.

Sr Software Engineer

Senior Software Engineer position at Amazon RBKS, focusing on AI and computer vision development for smart home applications in Sunnyvale, CA.

Senior Product Manager, Feed Relevance

Senior Product Manager position at LinkedIn focusing on Feed Relevance and AI/ML implementation to enhance user experience and content delivery.

Senior AI Engineer

Senior AI Engineer position at LinkedIn focusing on machine learning and big data solutions for the world's largest professional network.