Machine Learning - Compiler Engineer II, AWS Neuron, Annapurna Labs

AWS is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For Machine Learning - Compiler Engineer II, AWS Neuron, Annapurna Labs

AWS Neuron is seeking a Machine Learning Compiler Engineer to join their innovative team working on the SDK that optimizes ML models for AWS Inferentia and Trainium custom chips. This role offers an exciting opportunity to be at the forefront of AI revolution, working on transforming complex ML models from frameworks like PyTorch, TensorFlow, and JAX for deployment on AWS's specialized hardware.

As a Compiler Engineer, you'll tackle challenging optimization problems for various ML model families, including large language models like Llama and Deepseek, stable diffusion, and vision transformers. The role requires deep technical understanding of ML models and compiler optimization techniques to generate optimal implementations.

AWS offers a collaborative environment with a diverse team that values knowledge-sharing and mentorship. You'll work alongside chip architects, runtime engineers, and ML teams, contributing to both proprietary and open-source software projects. The position provides competitive compensation ($129,300-$223,600 based on location) and comprehensive benefits.

The ideal candidate brings 3+ years of software development experience, strong object-oriented programming skills, and preferably experience with compiler design or ML frameworks. You'll be part of AWS's mission to democratize AI access while working on cutting-edge technology that impacts developers worldwide.

This role combines technical depth with business impact, offering opportunities to work with the latest ML technologies while solving complex engineering challenges. Join AWS to shape the future of AI infrastructure and be part of a team that values innovation, diversity, and professional growth.

Last updated 11 hours ago

Responsibilities For Machine Learning - Compiler Engineer II, AWS Neuron, Annapurna Labs

  • Design, implement, test, deploy and maintain innovative software solutions for Neuron compiler
  • Work with chip architects, runtime/OS engineers, scientists and ML Apps teams
  • Optimize ML workloads on AWS software and hardware
  • Create compiler optimization and verification passes
  • Build features to surface AWS accelerator capabilities to developers
  • Implement tools to analyze numerical errors
  • Participate in design discussions and code reviews
  • Communicate with internal and external stakeholders

Requirements For Machine Learning - Compiler Engineer II, AWS Neuron, Annapurna Labs

Python
Java
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Experience with object-oriented languages like C++/Java

Benefits For Machine Learning - Compiler Engineer II, AWS Neuron, Annapurna Labs

Medical Insurance
401k
  • Full range of medical benefits
  • Financial benefits
  • Work-life harmony
  • Career growth opportunities
  • Mentorship programs

Interested in this job?

Jobs Related To Amazon Machine Learning - Compiler Engineer II, AWS Neuron, Annapurna Labs

ML Engineer, Devices and Services Security

ML Engineer position at Amazon focusing on developing AI solutions for device security, offering competitive salary and comprehensive benefits.

Machine Learning Engineer, AGIF

Machine Learning Engineer position at Amazon's AGI Finetuning organization, focusing on developing and maintaining AI model evaluation systems with competitive compensation and benefits.

Software Development Engineer, Transcribe

Mid-level Software Development Engineer role at AWS Transcribe team, focusing on building scalable ML/AI solutions for speech and language processing, requiring 3+ years of experience.

Software Development Engineer, AGI - Content Management and Protection

Software Engineer role at Amazon focusing on AGI systems, data compliance, and model evaluation, offering competitive compensation and opportunity to shape ethical AI development.

Software Development Engineer II, Search Science and Data Infrastructure

Software Development Engineer II position at Amazon Search, focusing on building ML and data infrastructure for the world's largest product search engine in Palo Alto, CA.