Senior ML Acceleration Engineer

Stack develops revolutionary AI and advanced autonomous systems for enhancing safety, reliability, and efficiency in the trucking transportation industry.
Machine Learning
Senior Software Engineer
Contact Company
5+ years of experience
AI · Automotive

Description For Senior ML Acceleration Engineer

Stack is at the forefront of developing revolutionary AI and advanced autonomous systems for the trucking transportation industry. Our technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies to create innovative solutions that enhance safety, reliability, and efficiency of modern operations.

We are seeking an experienced and hands-on engineer for our ML acceleration team within the training and deployment team, part of the ML Platform org at Stack AV. This role is crucial in developing and optimizing the platform that enables our AI team to build, optimize, test, and deploy models on autonomous vehicles.

As an ML Acceleration Engineer, you will be responsible for analyzing and profiling ML models, implementing optimizations using CUDA, Triton, and custom kernels, and automating the process of exporting models to optimized formats like TensorRT. You'll work closely with ML researchers to balance model accuracy and speed, and collaborate with cross-functional teams to understand data requirements and design appropriate solutions.

The ideal candidate will have a deep understanding of GPUs and optimization, excellent collaboration skills, and the ability to drive technical excellence. This role offers an opportunity to work with cutting-edge technologies in the autonomous vehicle industry and make a significant impact on the future of transportation.

Join Stack and be part of a team dedicated to creating an autonomous solution ecosystem tailored to the unique demands of the trucking industry. We offer a diverse and inclusive work environment that values entrepreneurship and innovation across all backgrounds and identities.

Note: This position may be subject to U.S. national security-related requirements and export control regulations. Candidates may need to meet specific residence, U.S. person status, and/or citizenship criteria.

Last updated 2 months ago

Responsibilities For Senior ML Acceleration Engineer

  • Analyze and profile ML models to identify performance bottlenecks
  • Use OSS tooling to enhance platform for ML engineers to profile and optimize models
  • Automate process of exporting models to optimized format and deploying them
  • Implement optimizations using CUDA, Triton, and custom kernels
  • Collaborate with ML researchers to balance model accuracy and speed
  • Develop efficient model export, optimization, and profiling solutions
  • Collaborate with cross-functional teams to understand data requirements and design solutions
  • Stay updated with latest technologies in ML inference and ML accelerators
  • Identify and resolve performance bottlenecks in models
  • Promote and maintain engineering excellence within the team

Requirements For Senior ML Acceleration Engineer

Python
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field
  • 5+ years of experience (including experience with GPU programming and optimization)
  • Strong programming skills in C++ and Python
  • Proven experience in GPU programming and optimization
  • Familiarity with deep learning frameworks, especially PyTorch
  • CUDA programming
  • Triton language for GPU kernels
  • PyTorch optimization techniques
  • TensorRT implementation
  • ONNX model conversion and deployment
  • Custom GPU kernel development
  • Strong analytical and problem-solving skills
  • Excellent verbal and written communication skills

Interested in this job?

Jobs Related To Stack Senior ML Acceleration Engineer

Senior Software Engineer

Senior Software Engineer position at Microsoft's Azure AI Platform team, focusing on developing and scaling large language model technologies and ML training infrastructure.

Senior Machine Learning Engineer

Senior Machine Learning Engineer role at Microsoft focusing on developing industry-leading ML solutions and working with researchers to implement novel algorithms.

Senior Software Engineer

Senior Software Engineer role at Microsoft's AI Frameworks team, developing AI software and infrastructure for various platforms from supercomputers to mobile devices.

Machine Learning Engineer 3

Senior Machine Learning Engineer role at Adobe focusing on Generative AI and ML techniques to enhance digital experience products.

Senior MLOps & Prompt Engineer

Senior MLOps & Prompt Engineer position at Acai Travel, building AI-driven travel technology with focus on LLM systems and MLOps infrastructure.