Sr. Software Engineer- AI/ML, AWS Neuron Apps

Amazon Web Services (AWS) is the world's leading cloud computing platform.
$151,300 - $261,500
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr. Software Engineer- AI/ML, AWS Neuron Apps

AWS Neuron is seeking a Senior Software Engineer to join their Machine Learning Applications team, focusing on the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators. This role represents a unique opportunity to work at the intersection of machine learning and high-performance computing, developing solutions for massive-scale language models and advanced AI applications.

The position involves collaborating with chip architects and engineers to optimize distributed training solutions, working with cutting-edge ML models including GPT-2, GPT-3, stable diffusion, and Vision Transformers. You'll be responsible for implementing and enhancing distributed training and inference support in frameworks like PyTorch and TensorFlow, while ensuring maximum performance on AWS's custom silicon.

Amazon offers a comprehensive benefits package, including competitive salary ranging from $151,300 to $261,500 based on location, plus equity and sign-on bonuses. The company's inclusive culture is reflected in its 16 Leadership Principles and supported by various employee-led affinity groups. They emphasize work-life balance and provide extensive opportunities for professional growth and mentorship.

The ideal candidate will bring 5+ years of software development experience, strong ML knowledge, and expertise in distributed systems. You'll be joining a team that values knowledge sharing, mentorship, and professional development, working on technology that powers some of the most advanced AI applications in the cloud computing industry.

Last updated 2 hours ago

Responsibilities For Sr. Software Engineer- AI/ML, AWS Neuron Apps

  • Lead efforts in building distributed training and inference support for PyTorch and TensorFlow
  • Work with chip architects, compiler engineers and runtime engineers
  • Create, build and tune distributed training solutions with Trn1
  • Performance tuning of ML model families including GPT2, GPT3, stable diffusion, and Vision Transformers
  • Maximize efficiency of models running on AWS Trainium and Inferentia silicon
  • Ensure highest performance of ML models on TRn1 and Inf1 servers

Requirements For Sr. Software Engineer- AI/ML, AWS Neuron Apps

Python
Java
  • 5+ years of programming experience with at least one software programming language
  • 5+ years of leading design or architecture experience
  • 5+ years of full software development life cycle experience
  • Experience with Python and ML model training
  • Knowledge of distributed training libraries like FSDP and Deepspeed
  • Strong software development and ML knowledge

Benefits For Sr. Software Engineer- AI/ML, AWS Neuron Apps

Medical Insurance
401k
Vision Insurance
Dental Insurance
  • Full range of medical benefits
  • Financial benefits
  • Flexible working hours
  • Mentorship and career growth opportunities
  • Employee-led affinity groups
  • Work-life balance focus

Interested in this job?

Jobs Related To Amazon Sr. Software Engineer- AI/ML, AWS Neuron Apps

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior ML Engineer role at AWS developing distributed training solutions for cloud-scale ML accelerators, working with cutting-edge AI technologies and custom silicon.

ML Compiler Engineer, Annapurna Labs

Senior ML Compiler Engineer role at AWS developing cutting-edge deep learning compiler stack for custom ML accelerators, offering competitive compensation and growth opportunities.

Senior ML Engineer, AWS Generative AI Innovation Center

Senior ML Engineer position at AWS Generative AI Innovation Center, focusing on developing AI solutions and helping customers implement generative AI technologies.

Sr. Software Development Engineer, AWS Compute Services

Senior SDE role at AWS focusing on ML/AI services, building distributed systems with 5+ years experience required, competitive salary $151K-$261K.

Sr. Software Engineer- AI/ML, AWS Neuron Apps

Senior Software Engineering role at AWS focusing on machine learning infrastructure, distributed training, and ML model optimization for cloud-scale accelerators.