Software Engineer II, Annapurna Labs

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS · Cloud

Description For Software Engineer II, Annapurna Labs

Annapurna Labs, acquired by AWS in 2015, serves as the infrastructure provider for AWS, focusing on silicon engineering, hardware design and verification, software, and operations. This role is for a Software Engineer II position within the AWS Neuron team, which develops the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators.

The position offers an exciting opportunity to lead the development of machine learning tools for running, optimizing, and analyzing ML workloads. The role combines technical leadership with hands-on development, requiring expertise in machine learning tools, profiling, optimization, and various instruction set architectures.

Working in a startup-like environment within AWS, you'll be part of a team that has delivered impressive products including AWS Nitro, ENA, EFA, Graviton, and F1 EC2 Instances. The team culture emphasizes knowledge-sharing, mentorship, and inclusive practices, with a strong focus on work-life harmony.

AWS values diverse experiences and provides comprehensive benefits, including medical coverage, financial benefits, and career development opportunities. The hybrid work model offers flexibility while maintaining opportunities for meaningful in-person collaboration.

This role is ideal for someone who wants to work at the intersection of machine learning and infrastructure, contributing to tools that will shape the future of cloud computing while being part of a supportive, innovative team that values both technical excellence and personal growth.

Last updated a day ago

Responsibilities For Software Engineer II, Annapurna Labs

  • Lead the design and implementation of new machine learning toolset
  • Work with developers, system architects, hardware engineers and users
  • Design and code solutions for software architecture efficiency
  • Create metrics and implement automation improvements
  • Resolve root cause of software defects
  • Build high-impact solutions for large customer base
  • Participate in design discussions and code review
  • Work cross-functionally to drive business decisions

Requirements For Software Engineer II, Annapurna Labs

Python
Java
Linux
  • Experience building complex software systems delivered to customers
  • Experience leading machine learning tool projects
  • Deep knowledge of profiling and optimization
  • Knowledge of resource management and scheduling
  • Experience with code generation
  • Experience with instruction set architectures (CPU, NPU, GPU)

Benefits For Software Engineer II, Annapurna Labs

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Medical, financial, and other benefits
  • Mentorship and career growth opportunities
  • Flexible work arrangements
  • Knowledge-sharing and learning experiences
  • Inclusive team culture
  • Employee-led affinity groups
  • Work-life harmony

Interested in this job?

Jobs Related To Amazon Software Engineer II, Annapurna Labs

SDE II - Machine Learning, Amazon

Machine Learning Software Development Engineer role at Amazon's advertising division, building scalable ML systems and pipelines.

Software Dev Engineer II, Amazon

Software Dev Engineer II position at Amazon focusing on developing LLMs for e-commerce, offering competitive compensation and opportunity to work on cutting-edge AI technology.

Machine Learning Engineer - GenAI, Creative-X, Amazon Advertising

Machine Learning Engineer role at Amazon Advertising focusing on GenAI and creative solutions, offering competitive compensation and opportunity to work with cutting-edge AI technologies.

Software Dev Engineer II, AGI - Modeling Services

Software Dev Engineer role at Amazon's AGI team, focusing on developing cutting-edge LLMs and AI solutions with competitive compensation and benefits.

Software Development Engineer (Big Data and ML) - FinTech

Software Development Engineer role at Amazon's FinTech team focusing on big data and machine learning for financial risk management and forecasting