Taro Logo

Software Engineer II, Annapurna Labs

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS · Cloud
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Software Engineer II, Annapurna Labs

Annapurna Labs, acquired by AWS in 2015, serves as the infrastructure provider for AWS, focusing on silicon engineering, hardware design and verification, software, and operations. This role is for a Software Engineer II position within the AWS Neuron team, which develops the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators.

The position offers an exciting opportunity to lead the development of machine learning tools for running, optimizing, and analyzing ML workloads. The role combines technical leadership with hands-on development, requiring expertise in machine learning tools, profiling, optimization, and various instruction set architectures.

Working in a startup-like environment within AWS, you'll be part of a team that has delivered impressive products including AWS Nitro, ENA, EFA, Graviton, and F1 EC2 Instances. The team culture emphasizes knowledge-sharing, mentorship, and inclusive practices, with a strong focus on work-life harmony.

AWS values diverse experiences and provides comprehensive benefits, including medical coverage, financial benefits, and career development opportunities. The hybrid work model offers flexibility while maintaining opportunities for meaningful in-person collaboration.

This role is ideal for someone who wants to work at the intersection of machine learning and infrastructure, contributing to tools that will shape the future of cloud computing while being part of a supportive, innovative team that values both technical excellence and personal growth.

Last updated 7 months ago

Responsibilities For Software Engineer II, Annapurna Labs

  • Lead the design and implementation of new machine learning toolset
  • Work with developers, system architects, hardware engineers and users
  • Design and code solutions for software architecture efficiency
  • Create metrics and implement automation improvements
  • Resolve root cause of software defects
  • Build high-impact solutions for large customer base
  • Participate in design discussions and code review
  • Work cross-functionally to drive business decisions

Requirements For Software Engineer II, Annapurna Labs

Python
Java
Linux
  • Experience building complex software systems delivered to customers
  • Experience leading machine learning tool projects
  • Deep knowledge of profiling and optimization
  • Knowledge of resource management and scheduling
  • Experience with code generation
  • Experience with instruction set architectures (CPU, NPU, GPU)

Benefits For Software Engineer II, Annapurna Labs

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Medical, financial, and other benefits
  • Mentorship and career growth opportunities
  • Flexible work arrangements
  • Knowledge-sharing and learning experiences
  • Inclusive team culture
  • Employee-led affinity groups
  • Work-life harmony

Interested in this job?