Software Engineer - AI/ML, AWS Neuron Distributed Training - Multimodal

AWS Utility Computing (UC) provides product innovations that set AWS's services apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Platform, and Productivity Apps services in AWS, including specialized security solutions. This role may involve exposure to Amazon's growing suite of generative AI services and cutting-edge cloud computing offerings.

Annapurna Labs, within AWS UC, designs silicon and software that accelerates innovation. AWS Neuron is the complete software stack for AWS Inferentia and Trainium, our cloud-scale Machine Learning accelerators. This role is for a machine learning engineer in the Distribute Training team for AWS Neuron, responsible for development, enablement, and performance tuning of various ML model families, including massive-scale Large Language Models (LLM), Stable Diffusion, and Vision Transformers (ViT).

Key responsibilities include:

• Leading efforts to build distributed training support into PyTorch and TensorFlow using XLA, Neuron compiler, and runtime stacks.
• Tuning models for highest performance and efficiency on AWS Trainium and Inferentia silicon and Trn1, Inf1/2 servers.
• Working with chip architects, compiler engineers, and runtime engineers to create, build, and tune distributed training solutions.

The team values knowledge-sharing, mentorship, and career growth. They offer a supportive environment for new members, with opportunities for one-on-one mentoring and thorough code reviews.

AWS values diverse experiences and encourages candidates to apply even if they don't meet all qualifications. The company fosters an inclusive culture through employee-led affinity groups and ongoing learning experiences.

Work-life harmony is prioritized, with flexibility as part of the working culture. AWS strives to become Earth's Best Employer by providing resources for knowledge-sharing, mentorship, and career advancement.