Software Engineer- AI/ML, AWS Neuron Distributed Training

Do you love decomposing problems to develop products that impact millions of people around the world? Would you enjoy identifying, defining, and building software solutions that revolutionize how businesses operate? The Annapurna Labs team at Amazon Web Services (AWS) is looking for a Software Development Engineer II to build, deliver, and maintain complex products that delight our customers and raise our performance bar.

You'll design fault-tolerant systems that run at massive scale as we continue to innovate best-in-class services and applications in the AWS Cloud. Annapurna Labs was a startup company acquired by AWS in 2015, and is now fully integrated. If AWS is an infrastructure company, then think Annapurna Labs as the infrastructure provider of AWS.

This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. You'll be responsible for development, enablement, and performance tuning of a wide variety of ML model families, including massive scale large language models like GPT2, GPT3 and beyond, as well as stable diffusion, Vision Transformers, and many more.

Key responsibilities include:

• Leading efforts to build distributed training support into PyTorch, TensorFlow using XLA, and the Neuron compiler and runtime stacks
• Tuning models to ensure highest performance and maximize efficiency on AWS Trainium and Inferentia silicon and the TRn1, Inf1 servers
• Working closely with chip architects, compiler engineers, and runtime engineers

We offer:

• Inclusive team culture with employee-led affinity groups
• Emphasis on work-life balance
• Mentorship and career growth opportunities
• Flexibility in working hours

Join us to revolutionize cloud-scale machine learning acceleration at AWS!