Sr ML Compiler Engineer, Annapurna Labs

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$151,300 - $261,500
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr ML Compiler Engineer, Annapurna Labs

AWS Machine Learning accelerators are leading AWS innovation in Generative AI development. The role focuses on the Inferentia chip and Trainium platforms, which deliver best-in-class ML inference and training performance in the cloud. As a Sr. Machine Learning Compiler Engineer III on the AWS Neuron team, you'll lead the development of a compiler handling the world's largest ML workloads. The position involves working with the AWS Neuron SDK, which includes an ML compiler, runtime, and integration with frameworks like PyTorch, TensorFlow, and MxNet.

You'll be part of the Amazon Annapurna Labs team, responsible for silicon development at AWS. The role requires architecting and implementing critical features, publishing research, and mentoring experienced engineers. You'll collaborate with AWS ML services teams and participate in pre-silicon design and new product launches.

The position offers comprehensive benefits, including medical, financial, and other benefits. AWS values work-life harmony and promotes an inclusive culture through employee-led affinity groups and inclusion events. The company provides extensive opportunities for knowledge-sharing, mentorship, and career advancement.

Key customers using AWS Neuron and Inferentia include Snap, Autodesk, Amazon Alexa, and Amazon Rekognition. The role requires 5+ years of professional software development experience, including leadership in design/architecture and full software development lifecycle expertise.

The compensation package is competitive, ranging from $151,300 to $261,500 per year based on geographic location, plus equity, sign-on payments, and comprehensive benefits. AWS values diverse experiences and welcomes candidates from non-traditional backgrounds.

Last updated 25 minutes ago

Responsibilities For Sr ML Compiler Engineer, Annapurna Labs

  • Lead development of compiler for large-scale ML workloads
  • Architect and implement business-critical features
  • Publish cutting-edge research
  • Mentor experienced engineers
  • Partner with AWS ML services teams
  • Participate in pre-silicon design
  • Bring new products/features to market

Requirements For Sr ML Compiler Engineer, Annapurna Labs

Python
Java
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language
  • 5+ years of leading design or architecture experience
  • 5+ years of full software development life cycle experience
  • Experience as a mentor, tech lead or leading an engineering team

Benefits For Sr ML Compiler Engineer, Annapurna Labs

Medical Insurance
Equity
  • Medical Insurance
  • Equity
  • Sign-on bonus
  • Career development opportunities
  • Mentorship programs
  • Work-life harmony
  • Comprehensive benefits package

Interested in this job?

Jobs Related To Amazon Sr ML Compiler Engineer, Annapurna Labs

Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Senior Machine Learning Compiler Engineer role at AWS developing cutting-edge compiler technologies for ML accelerators, offering competitive compensation and opportunity to work on innovative AI infrastructure.

Senior Applied Scientist, Computer Vision, AWS Infrastructure Service

Senior Applied Scientist role focusing on Computer Vision systems for AWS data centers, combining ML expertise with practical implementation for infrastructure automation.

Member of Technical Staff-PMT (Customer), AGI Autonomy

Product Manager Technical role at Amazon's AI research lab, focusing on developing and implementing AI agent technologies for customer solutions.

Member of Technical Staff - Software Engineer - ML Infrastructure, AGI Autonomy

Senior technical role developing AI agent infrastructure and tools at Amazon's new San Francisco research lab, focusing on LLMs and reinforcement learning.

Language Data Scientist III, AWS Q for Business

Senior data science role at AWS focusing on AI language models, data quality, and enterprise solutions, offering competitive compensation and comprehensive benefits.