Machine Learning - Compiler Engineer II, Annapurna Labs

Amazon Web Services (AWS) is the world's leading cloud computing platform.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For Machine Learning - Compiler Engineer II, Annapurna Labs

AWS Machine Learning accelerators represent the cutting edge of AWS innovation, particularly in the realm of Generative AI development. The position is within the Amazon Annapurna Labs team, which spearheads silicon development at AWS, focusing on the AWS Neuron team that optimizes neural net model performance on custom AWS hardware.

As a Machine Learning Compiler Engineer II, you'll be at the forefront of developing a compiler system that handles the world's largest ML workloads. The role involves working with AWS's custom chips - Inferentia, which delivers best-in-class ML inference performance at the lowest cost in cloud, and Trainium, designed for optimal ML training performance.

The position requires expertise in compiler optimization and software development, with a focus on the AWS Neuron Software Development Kit (SDK). This SDK includes an ML compiler and runtime that integrates with popular ML frameworks like PyTorch, TensorFlow, and MxNet. The technology you'll work with is already being used at scale by major customers including Snap, Autodesk, Amazon Alexa, and Amazon Rekognition.

The role offers an exceptional opportunity to work with some of the brightest minds in engineering, research, and product development. You'll be involved in architecting and implementing critical features, publishing cutting-edge research, and working directly with AWS ML services teams. The position also includes participation in pre-silicon design and bringing new products and features to market.

Amazon offers a comprehensive benefits package, including competitive salary, medical and financial benefits, and flexible working hours. The company strongly emphasizes work-life balance and provides numerous opportunities for professional growth through mentorship and knowledge sharing. The team culture is highly inclusive, supported by ten employee-led affinity groups with over 40,000 members globally.

This is an ideal position for someone who wants to make a significant impact in the field of machine learning hardware acceleration while working with cutting-edge technology at one of the world's leading tech companies. The role combines technical depth with broad impact, offering the chance to influence the future of ML infrastructure at AWS.

Last updated 4 hours ago

Responsibilities For Machine Learning - Compiler Engineer II, Annapurna Labs

  • Support ground-up development and scaling of a compiler for large ML workloads
  • Architect and implement business-critical features
  • Publish cutting-edge research
  • Partner with AWS ML services teams
  • Participate in pre-silicon design
  • Bring new products/features to market

Requirements For Machine Learning - Compiler Engineer II, Annapurna Labs

Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of experience architecting and optimizing compilers
  • Proficiency with C++ (preferred), C, or Python
  • M.S. or Ph.D. in Computer Science or related field (preferred)
  • Experience with multiple toolchains and Instruction Set Architectures (preferred)
  • Proficiency with resource management, scheduling, code generation, and compute graph optimization (preferred)
  • Experience optimizing Tensorflow, PyTorch or MxNET deep learning models (preferred)

Benefits For Machine Learning - Compiler Engineer II, Annapurna Labs

Medical Insurance
401k
  • Medical, financial, and other benefits
  • Flexible working hours
  • Mentorship and career growth opportunities
  • Employee-led affinity groups
  • Inclusive team culture
  • Work-life balance

Interested in this job?

Jobs Related To Amazon Machine Learning - Compiler Engineer II, Annapurna Labs

Software Development Engineer II, Search Science and Data Infrastructure

Software Development Engineer II position at Amazon Search, focusing on building ML and data infrastructure for the world's largest product search engine in Palo Alto, CA.

Language Engineer II, Alexa Customer Journeys

Language Engineer II position at Amazon's Alexa team, focusing on NLP, ML, and LLMs to improve Alexa's language understanding capabilities.

Software Development Engineer II, DSI

Software Development Engineer II position at Amazon's Customer Behavior Analytics team, focusing on building causal machine learning systems and big data processing.

Machine Learning Engineer, Advertising in Live Events

Machine Learning Engineer role at Amazon's ALE team, focusing on revolutionizing sports advertising through AI/ML, offering $129K-$223K salary with comprehensive benefits.

Machine Learning Engineer, Supply Chain Optimization Technologies

Machine Learning Engineer role at Amazon's SCOT team, focusing on applying ML and reinforcement learning to solve complex supply chain optimization problems.