ML Compiler Engineer, AWS Neuron, Annapurna Labs

AWS is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$120,000 - $200,000
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For ML Compiler Engineer, AWS Neuron, Annapurna Labs

AWS Neuron team is seeking a ML Compiler Engineer to join Annapurna Labs, the infrastructure provider of AWS. This role focuses on developing compiler technology for AWS Inferentia and Trainium, custom chips designed for deep-learning workloads. The position involves working with the Neuron SDK, which includes a compiler, run-time, and debugger integrated with major ML frameworks.

As a deep learning compiler engineer, you'll be at the intersection of machine learning, high-performance computing, and distributed architectures. The role offers unique opportunities to work on cutting-edge products that impact millions of users worldwide. You'll be involved in pre-silicon design, bringing new products to market, and developing solutions that democratize access to cutting-edge infrastructure.

The team operates in a startup-like environment within AWS, focusing on innovation and experimentation. You'll work with diverse teams across multiple disciplines including silicon engineering, hardware design, software, and operations. The role requires technical expertise and curiosity, as you'll be supporting AWS ML services teams and contributing to various exciting projects.

AWS values diverse experiences and maintains an inclusive culture. The team emphasizes work-life balance and provides flexibility in working hours. Career growth is supported through knowledge sharing, mentorship, and opportunities to work on increasingly complex tasks. You'll be part of a team that has delivered significant products like AWS Nitro, ENA, EFA, Graviton, and ML Accelerators.

This position offers the chance to work on some of the world's largest ML workloads while contributing to innovative solutions that transform how businesses operate. The role combines technical challenge with business impact, making it ideal for engineers passionate about pushing the boundaries of ML infrastructure.

Last updated 21 hours ago

Responsibilities For ML Compiler Engineer, AWS Neuron, Annapurna Labs

  • Design and implement business-critical features
  • Publish cutting-edge research
  • Mentor experienced engineers
  • Develop and scale compiler to handle large ML workloads
  • Solve challenging technical problems across all stack layers
  • Design, implement, test, deploy and maintain innovative software solutions
  • Build high-quality, highly available products
  • Participate in design discussions and code reviews
  • Work cross-functionally to drive business decisions

Requirements For ML Compiler Engineer, AWS Neuron, Annapurna Labs

Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Experience with design patterns, reliability and scaling of new and existing systems

Benefits For ML Compiler Engineer, AWS Neuron, Annapurna Labs

Medical Insurance
Parental Leave
Education Budget
  • Work-life balance
  • Flexible working hours
  • Career growth opportunities
  • Mentorship
  • Inclusive work environment
  • Diverse team culture

Interested in this job?

Jobs Related To Amazon ML Compiler Engineer, AWS Neuron, Annapurna Labs

Software Development Engineer, Promotion Analytics and Optimization Services

Software Development Engineer role at Amazon focusing on machine learning and data analytics for promotion optimization, offering competitive salary and benefits in Vancouver.

Software Development Engineer, Predictive Targeting

Software Development Engineer role at Amazon focusing on machine learning and predictive analytics for customer targeting systems.

Software Development Engineer II, ML_AI

AWS SageMaker AI seeks SDE II to build next-gen AI platform, focusing on LLMs and distributed machine learning systems, offering competitive compensation and growth opportunities.

Software Development Engineer, Selling Partner Experience

SDE role at Amazon working on AI-driven Selling Assistant, focusing on LLMs and ML technologies to revolutionize seller experience

Software Engineer- AI/ML, AWS Neuron Machine Learning Distributed Training, ML Accuracy

AWS Neuron seeks ML Engineer to develop distributed training solutions for large language models using PyTorch, TensorFlow, and JAX on custom silicon.