Taro Logo

Software Engineer - Hardware Abstraction Layer, AWS Machine Learning Accelerators

AWS is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Embedded
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Software Engineer - Hardware Abstraction Layer, AWS Machine Learning Accelerators

AWS's Annapurna Labs organization is seeking talented engineers to join their system software team developing hardware abstraction layers (HAL) for cutting-edge machine learning accelerators. This role focuses on building and scaling the critical software infrastructure that manages AWS's custom silicon chips, including Trainium and Inferentia, which power their machine learning servers.

The position offers a unique opportunity to work at the intersection of hardware and software, developing low-level system software that forms the foundation of AWS's infrastructure management stack. You'll collaborate with hardware designers and system software teams to architect solutions, debug complex systems, and innovate on cross-functional challenges.

The ideal candidate will have strong C++ programming skills, experience with hardware-based systems, and the ability to build effective abstractions over low-level SoC details. While the role supports machine learning infrastructure, no ML background is required as the focus is on system-level software development.

Working at AWS's Annapurna Labs means joining a team that's changing the industry through custom silicon innovation. You'll be part of a fast-paced, collaborative environment split between Cupertino, CA and Austin, TX, working alongside thought-leaders in multiple technology areas. The role offers competitive compensation, comprehensive benefits, and significant opportunities for career growth and mentorship.

This position is perfect for engineers who are passionate about low-level software development, enjoy solving complex technical challenges, and want to contribute to the future of cloud computing and machine learning infrastructure at scale.

Last updated 7 months ago

Responsibilities For Software Engineer - Hardware Abstraction Layer, AWS Machine Learning Accelerators

  • Work with hardware designers to build HALs for newly developed SoC IPs
  • Work with system software teams to solve SoC and system-level architectural issues
  • Continuously test and deploy software stack to multiple internal customers
  • Refactor and maintain existing codebases throughout the device lifecycle
  • Innovate on tooling provided to customers

Requirements For Software Engineer - Hardware Abstraction Layer, AWS Machine Learning Accelerators

Python
Linux
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with C++
  • Strong knowledge of hardware-based systems
  • Familiarity with modular driver architectures

Benefits For Software Engineer - Hardware Abstraction Layer, AWS Machine Learning Accelerators

Medical Insurance
Equity
Mental Health Assistance
  • Medical, financial, and other benefits
  • Equity compensation
  • Mentorship and career growth opportunities
  • Inclusive team culture
  • Work-life harmony

Interested in this job?