Senior Software Engineer - Hardware Abstraction Layer, Team Lead, AWS Machine Learning Accelerators

AWS is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$151,300 - $261,500
Backend
Staff Software Engineer
In-Person
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer - Hardware Abstraction Layer, Team Lead, AWS Machine Learning Accelerators

AWS's Annapurna Labs is seeking a hands-on technical leader for their system-on-chip hardware abstraction layer (SoC HAL) software team. This role is critical in managing AWS machine learning servers (Trainium and Inferentia) through backend software development. The position involves leading a small team of 3-5 developers while working closely with hardware designers and system software teams to build and maintain HALs for newly developed SoC IPs.

The ideal candidate will have strong C++ programming skills, experience with hardware-based systems, and the ability to solve complex system-level issues. While the team works on ML chips, no machine learning background is required as the focus is on low-level infrastructure management.

This is an opportunity to work with AWS's custom silicon division, Annapurna Labs, which designs and deploys some of the largest custom silicon in the world. The role offers the chance to work in a startup-like environment within AWS, focusing on innovation and technical excellence.

The position can be based in either Cupertino, CA or Austin, TX, with competitive compensation ranging from $151,300 to $261,500 based on location and experience. AWS offers a comprehensive benefits package including equity, sign-on payments, and various medical and financial benefits.

The role requires 6+ years of programming experience, strong system architecture skills, and experience with low-level software development. You'll be part of AWS Utility Computing (UC), supporting the development of various AWS services while working on cutting-edge cloud computing solutions.

AWS values diversity and inclusion, offering various employee-led affinity groups and ongoing learning experiences. The company emphasizes work-life harmony and provides extensive opportunities for mentorship and career growth. Join AWS to be part of a team that's changing the industry and building the future of machine learning infrastructure.

Last updated 5 days ago

Responsibilities For Senior Software Engineer - Hardware Abstraction Layer, Team Lead, AWS Machine Learning Accelerators

  • Lead a small team of 3-5 developers both technically and as a people-manager
  • Work with hardware designers to build HALs for newly developed SoC IPs
  • Work with system software teams to solve SoC and system-level architectural issues
  • Continuously test and deploy software stack to multiple internal customers
  • Refactor and maintain existing codebases
  • Innovate on tooling provided to customers

Requirements For Senior Software Engineer - Hardware Abstraction Layer, Team Lead, AWS Machine Learning Accelerators

Python
Linux
  • 6+ years of programming with modern languages
  • 6+ years of non-internship professional software development experience
  • 4+ years of designing or architecting systems experience
  • Experience leading design, build and deployment of complex software solutions
  • C++ development experience
  • Experience developing low-level software for hardware

Benefits For Senior Software Engineer - Hardware Abstraction Layer, Team Lead, AWS Machine Learning Accelerators

Medical Insurance
Equity
  • Medical, financial, and other benefits
  • Equity
  • Sign-on payments
  • Total compensation package
  • Career growth and mentorship opportunities
  • Work-life harmony

Interested in this job?

Jobs Related To Amazon Senior Software Engineer - Hardware Abstraction Layer, Team Lead, AWS Machine Learning Accelerators

Sr. EU Site Process Engineer, EU PE

Senior EU Site Process Engineer position at Amazon, focusing on process improvement and operational excellence in fulfillment centers.

Software Development Manager (Performance), Aurora PostgreSQL Team

Lead performance engineering for AWS Aurora PostgreSQL, optimizing cloud-native databases and managing engineering teams.

Software Development Engineer (Level 5), Skynet

Senior Software Development Engineer role at Amazon's Skynet team, focusing on network automation and infrastructure at global scale.

Sr. Technical Program Manager, Reverse Logistics (RL) Engineering

Senior Technical Program Manager role at Amazon Lab126, leading reverse logistics engineering for consumer electronics products with competitive compensation and benefits.

Software Development Manager, Global Talent Management & Compensation (GTMC)

Lead software development team building talent management solutions at Amazon, managing front-end and back-end services for global workforce development.