System Development Engineer II, Annapurna Labs

Annapurna Labs, acquired by AWS in 2015, serves as the infrastructure provider for AWS. This role is for a Software Engineer who will lead the development of machine learning tools to run, optimize, and analyze machine learning workloads. The position is within a team that has delivered various products including AWS Nitro, ENA, EFA, Graviton, F1 EC2 Instances, AWS Neuron, Inferentia, and Trainium ML Accelerators.

The ideal candidate will lead the design and implementation of new toolsets, working closely with developers, system architects, and hardware engineers. Deep knowledge of profiling, optimization, resource management, scheduling, and code generation is essential. Experience with new instruction set architectures, including CPU, NPU, and GPU, is highly valued.

The team operates in a startup-like environment while benefiting from AWS's scale and resources. They emphasize knowledge-sharing, mentorship, and career growth, with senior members providing one-on-one mentoring and thorough code reviews. The culture promotes diversity, inclusion, and work-life harmony, with flexible hybrid working arrangements available.

AWS values diverse experiences and encourages applications from candidates with non-traditional backgrounds. The position offers competitive compensation based on geographic location, ranging from $116,300 to $201,200 per year, plus additional benefits including equity, sign-on payments, and comprehensive medical and financial benefits.

The role combines the excitement of working on cutting-edge machine learning infrastructure with the stability and resources of AWS, making it an excellent opportunity for engineers passionate about ML tools and systems development.