ML Compiler Engineer, Annapurna Labs

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing innovation.
$129,300 - $223,600
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For ML Compiler Engineer, Annapurna Labs

The AWS Neuron Compiler team at Amazon is seeking experienced compiler engineers to join their cutting-edge deep learning compiler development efforts. This role focuses on optimizing application models across various domains, including Large Language Models and Vision, working with frameworks like PyTorch, TensorFlow, and JAX.

The position is within Annapurna Labs, an AWS organization that designs silicon and software to accelerate cloud innovation. As a ML Compiler Engineer, you'll be working on AWS's custom-built Machine Learning accelerators (Inferentia/Trainium) that power advanced ML capabilities including Generative AI.

Your responsibilities will include designing and developing compiler features, working on crucial challenges in compiler technology and deep-learning systems software. You'll be involved in various aspects including instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, and hardware-software co-design.

The role offers significant growth opportunities through knowledge-sharing and mentorship. You'll be part of AWS Utility Computing (UC), which provides foundational services like Amazon S3 and EC2, and continues to innovate in cloud services. The team values diverse experiences and maintains an inclusive culture that celebrates knowledge-sharing and mentorship.

The position offers competitive compensation ranging from $129,300 to $223,600 based on geographic location, plus equity and comprehensive benefits. You'll be working in a startup-like environment while having the resources and impact of AWS, the world's leading cloud platform. This is an excellent opportunity for someone passionate about compiler technology and machine learning infrastructure who wants to make a significant impact on cloud computing technology.

Last updated an hour ago

Responsibilities For ML Compiler Engineer, Annapurna Labs

  • Design, develop, and optimize features for ML compiler stack
  • Work on instruction scheduling, memory allocation, and data transfer optimization
  • Collaborate with Runtime, Frameworks, and Hardware teams
  • Participate in hardware-software co-design
  • Solve challenging technical problems across all stack layers
  • Implement and maintain innovative software solutions
  • Participate in design discussions and code reviews
  • Work cross-functionally to drive business decisions

Requirements For ML Compiler Engineer, Annapurna Labs

Python
  • B.S. or M.S. in computer science or related field
  • Proficiency with C++ (preferred) or Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of experience developing compiler optimization, graph-theory, hardware bring-up, FPGA placement and routing algorithms, or hardware resource management

Benefits For ML Compiler Engineer, Annapurna Labs

Medical Insurance
401k
Mental Health Assistance
  • Medical benefits
  • Financial benefits
  • Career growth opportunities
  • Mentorship programs
  • Work-life harmony
  • Employee-led affinity groups
  • Inclusive culture

Interested in this job?

Jobs Related To Amazon ML Compiler Engineer, Annapurna Labs

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior ML Engineer role at AWS developing distributed training solutions for cloud-scale ML accelerators, working with cutting-edge AI technologies and custom silicon.

Senior ML Engineer, AWS Generative AI Innovation Center

Senior ML Engineer position at AWS Generative AI Innovation Center, focusing on developing AI solutions and helping customers implement generative AI technologies.

Sr. Software Development Engineer, AWS Compute Services

Senior SDE role at AWS focusing on ML/AI services, building distributed systems with 5+ years experience required, competitive salary $151K-$261K.

Sr. Software Engineer- AI/ML, AWS Neuron Apps

Senior Software Engineering role at AWS focusing on machine learning infrastructure, distributed training, and ML model optimization for cloud-scale accelerators.

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior Software Engineering role at AWS focusing on machine learning applications, distributed training systems, and performance optimization for custom ML accelerators.