Sr. Software Engineer- AI/ML, AWS Neuron Apps

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing innovation.
$151,300 - $261,500
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS · Cloud

Description For Sr. Software Engineer- AI/ML, AWS Neuron Apps

AWS Neuron is seeking a Senior Software Engineer to join their Machine Learning Applications (ML Apps) team, focusing on the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators. This role sits at the intersection of cutting-edge ML infrastructure and large-scale distributed systems, working with massive language models like GPT-2 and GPT-3, stable diffusion, and Vision Transformers.

As part of AWS Utility Computing (UC), you'll contribute to foundational services like S3 and EC2, while working alongside chip architects and compiler engineers to optimize ML model performance. The position offers a unique opportunity to shape the future of machine learning infrastructure at AWS, working with state-of-the-art accelerator hardware and distributed training frameworks.

Amazon's culture emphasizes work-life harmony, inclusive team environments, and continuous learning. The company offers comprehensive benefits, mentorship opportunities, and career growth through various channels including employee-led affinity groups and ongoing learning experiences. The role combines deep technical expertise in ML systems with the scale and impact of AWS's cloud infrastructure.

The compensation package reflects Amazon's commitment to top talent, with a base salary range of $151,300 to $261,500 depending on location, plus equity and comprehensive benefits. This role requires strong software development skills combined with deep ML knowledge, making it ideal for engineers passionate about both high-performance computing and machine learning systems.

Last updated an hour ago

Responsibilities For Sr. Software Engineer- AI/ML, AWS Neuron Apps

  • Lead development of distributed training and inference support in PyTorch and TensorFlow
  • Performance tuning of ML models on AWS Trainium and Inferentia silicon
  • Work with chip architects, compiler engineers and runtime engineers
  • Create, build and tune distributed training solutions with Trn1
  • Extend distributed training libraries like FSDP and Deepspeed for Neuron based systems

Requirements For Sr. Software Engineer- AI/ML, AWS Neuron Apps

Python
Java
  • 5+ years of programming experience with modern languages (Java, C++, or C#)
  • 5+ years of leading design or architecture experience
  • 5+ years of full software development life cycle experience
  • Strong knowledge of Machine learning and deep learning models
  • Experience with model architecture, training and inference lifecycles
  • Experience with model execution optimizations
  • Object-oriented design experience
  • Knowledge of design patterns, reliability and scaling

Benefits For Sr. Software Engineer- AI/ML, AWS Neuron Apps

Medical Insurance
401k
Equity
  • Full range of medical benefits
  • Financial benefits
  • Work-life balance
  • Flexible working hours
  • Mentorship and career growth opportunities
  • Employee-led affinity groups
  • Inclusive work culture

Interested in this job?

Jobs Related To Amazon Sr. Software Engineer- AI/ML, AWS Neuron Apps

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior ML Engineer role at AWS developing distributed training solutions for cloud-scale ML accelerators, working with cutting-edge AI technologies and custom silicon.

ML Compiler Engineer, Annapurna Labs

Senior ML Compiler Engineer role at AWS developing cutting-edge deep learning compiler stack for custom ML accelerators, offering competitive compensation and growth opportunities.

Senior ML Engineer, AWS Generative AI Innovation Center

Senior ML Engineer position at AWS Generative AI Innovation Center, focusing on developing AI solutions and helping customers implement generative AI technologies.

Sr. Software Development Engineer, AWS Compute Services

Senior SDE role at AWS focusing on ML/AI services, building distributed systems with 5+ years experience required, competitive salary $151K-$261K.

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior Software Engineering role at AWS focusing on machine learning applications, distributed training systems, and performance optimization for custom ML accelerators.