Software Engineer, Annapurna Labs ML Acceleration System Software

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$120,000 - $200,000
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Software Engineer- AI/ML, AWS Neuron Machine Learning Distributed Training, ML Accuracy

AWS Neuron seeks ML Engineer to develop distributed training solutions for large language models using PyTorch, TensorFlow, and JAX on custom silicon.

Software Engineer- AI/ML, AWS Neuron

AWS Neuron ML Engineer role focusing on distributed training and optimization of large language models using AWS Inferentia and Trainium accelerators.

Software Development Engineer, Finance Technology

Build AI/ML applications for Amazon's finance systems, focusing on data processing, forecasting, and automation within the FinTech team.

Machine Learning Engineer, MLE II, Amazon Q in QuickSight

Machine Learning Engineer role at Amazon working on Q in QuickSight, focusing on LLMs and NLP for business intelligence solutions.

Software Development Engineer, SageMaker Training Platform

Software Development Engineer position at Amazon's SageMaker Training Platform, building and scaling machine learning infrastructure.

Description For Software Engineer, Annapurna Labs ML Acceleration System Software

Annapurna Labs, part of Amazon Web Services (AWS), is seeking a Software Engineer for their Machine Learning Server Software Team. This role focuses on hardware/software co-design for ML acceleration systems. The position involves working with physical systems that execute and accelerate machine learning algorithms, rather than developing ML algorithms themselves. The team specializes in data paths, I2C infrastructure, and accelerator technologies.

The role combines system-level software development with hardware integration, requiring expertise in languages like C/C++, Python, and Lua. You'll be working on server components integration with EC2, collaborating with hardware, test, and manufacturing teams to develop and deploy software solutions. The position emphasizes creating maintainable, well-documented, and reusable code.

AWS offers a supportive environment with opportunities for mentorship and professional growth. The team values knowledge-sharing, thorough code reviews, and career development. They maintain an inclusive culture that celebrates diversity through employee-led affinity groups and ongoing learning experiences.

As part of AWS, you'll be working with the world's most comprehensive cloud platform, contributing to technologies that power businesses from startups to Global 500 companies. The role offers work-life harmony, flexible working arrangements, and a culture that supports continuous learning and innovation.

The ideal candidate should have experience in system programming, interest in cloud-scale computer hardware, and knowledge of high-speed computer interfaces. This position offers an opportunity to work at the forefront of hardware/software co-design while being part of a team that values both technical excellence and inclusive growth.

Last updated 2 months ago

Responsibilities For Software Engineer, Annapurna Labs ML Acceleration System Software

  • Member of a team responsible for the software associated with server components and integration in to EC2
  • Working with the MLA Hardware, Test and Manufacturing teams
  • Creating coordinated software package for qualification and rapid deployment
  • Developing maintainable software in C/C++, Python, Lua
  • Debug, testing, qualification, and manufacturing of server software

Requirements For Software Engineer, Annapurna Labs ML Acceleration System Software

Python
Linux
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Knowledge of system programming concepts including device-drivers, device trees, and Linux system programming
  • Interest in high speed computer interfaces including PCIe and memory subsystems

Benefits For Software Engineer, Annapurna Labs ML Acceleration System Software

Medical Insurance
Dental Insurance
Vision Insurance
  • Work-life harmony
  • Flexible working culture
  • Mentorship and career growth opportunities
  • Knowledge-sharing and professional development
  • Employee-led affinity groups
  • Inclusive team culture

Interested in this job?