Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

AWS is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuously innovating.
$151,300 - $261,500
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

AWS Neuron is seeking a Senior Machine Learning Compiler Engineer to join their innovative team working on the SDK that optimizes ML models for AWS Inferentia and Trainium custom chips. This role offers an exciting opportunity to be at the forefront of AI revolution, working on next-generation compiler technology that transforms ML models from frameworks like PyTorch, TensorFlow, and JAX for deployment on AWS hardware.

The position involves solving complex compiler optimization problems to achieve optimal performance for various ML model families, including large language models, stable diffusion, and vision transformers. You'll work closely with chip architects, runtime engineers, and ML teams to deliver cutting-edge solutions that democratize access to AI infrastructure.

As a senior engineer, you'll lead the design and implementation of compiler optimizations, collaborate with open-source communities, and influence industry-wide partners. The role requires strong expertise in object-oriented programming (C++/Java) and compiler technology. Experience with LLVM/MLIR and ML frameworks is highly valued.

AWS offers a collaborative environment with emphasis on mentorship and career growth. The team maintains a startup-like atmosphere while providing the resources and stability of a global tech leader. You'll have opportunities to work on impactful projects that shape the future of machine learning infrastructure.

Benefits include comprehensive healthcare, work-life harmony, and extensive professional development opportunities. The position offers competitive compensation ranging from $151,300 to $261,500 based on location and experience, plus equity and additional benefits.

Join AWS to be part of a diverse, inclusive culture that values innovation and technical excellence. This role provides an unique opportunity to influence the future of AI infrastructure while working with cutting-edge technology at global scale.

Last updated 5 hours ago

Responsibilities For Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

  • Design, implement, test, deploy and maintain innovative software solutions for Neuron compiler
  • Work with chip architects, runtime/OS engineers, scientists and ML Apps teams
  • Collaborate with open-source communities
  • Create compiler optimization and verification passes
  • Build features for AWS accelerators
  • Implement tools to analyze numerical errors
  • Resolve compiler defects
  • Participate in design discussions and code reviews
  • Communicate with internal and external stakeholders

Requirements For Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Python
Java
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language
  • 5+ years of leading design or architecture of new and existing systems
  • 5+ years of full software development life cycle experience
  • Experience as a mentor, tech lead or leading an engineering team
  • Master's degree or PhD in Computer Science or related field (preferred)
  • Experience in compiler design for CPU/GPU/Vector engines/ML-accelerators (preferred)
  • Experience with OpenSource compiler toolset like LLVM/MLIR (preferred)
  • Experience with PyTorch, OpenXLA, StableHLO, JAX, TVM (preferred)

Benefits For Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Medical Insurance
401k
Parental Leave
Education Budget
  • Comprehensive medical benefits
  • Work-life harmony
  • Career development and mentorship opportunities
  • Employee-led affinity groups
  • Inclusive work culture
  • Knowledge-sharing and mentorship programs

Interested in this job?

Jobs Related To Amazon Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Sr. Physical Design Engineer - Static Timing Analysis, Annapurna Labs, Cloud Scale Machine Learning

Senior Physical Design Engineer role at AWS focusing on static timing analysis and machine learning acceleration, offering competitive compensation and comprehensive benefits.

Senior Software Dev Engineer, Product Quality Tech

Senior Software Engineer role at Amazon focusing on AI/ML systems to protect marketplace integrity and customer trust through product quality verification.

Senior Software Engineer-AI, Annapurna Labs

Senior Software Engineer role at AWS focusing on AI infrastructure automation, combining cloud computing expertise with artificial intelligence innovation.

Sr. Software Dev. Engineer/MLE, AGI Customization

Senior Machine Learning Engineer role at Amazon's AGI team focusing on LLM training techniques and AI model customization.

Software Development Engineer III, Annapurna Labs

Senior Software Engineer role at Amazon's Annapurna Labs, developing ML compiler infrastructure for AWS's custom hardware accelerators.