Machine Learning Engineer, AWS Neuron Apps

Global technology company leading in e-commerce, cloud computing, and artificial intelligence
$129,300 - $223,600
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Sr Software Engineer

Senior Software Engineer role at Amazon RBKS focusing on AI and computer vision system development for smart home applications, offering competitive compensation and growth opportunities.

Software Development Engineer, Amazon Robotics

Senior Software Engineer role at Amazon Robotics, focusing on ML infrastructure and distributed systems for robotics applications.

Software Development Engineer, Amazon Robotics (AR) Sortation Planning

Senior ML Engineer role at Amazon Robotics focusing on developing and implementing machine learning solutions for robotic sortation systems and workflow optimization.

Senior Delivery Consultant - Application Developer, Data & Machine Learning, WWPS ProServe

Senior Delivery Consultant role at AWS ProServe team focusing on machine learning and data solutions implementation, requiring 5+ years of experience in cloud architecture and ML deployment.

Software Development Engineer - Machine Learning, Ad Response Prediction

Senior ML Engineer role at Amazon working on ad response prediction systems, requiring 3+ years of experience in software development.

Description For Machine Learning Engineer, AWS Neuron Apps

AWS Neuron is seeking a Senior Machine Learning Engineer to join their ML Applications team, focusing on the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators. This role presents an exciting opportunity to work at the forefront of machine learning infrastructure, specifically with massive-scale language models like Llama2, GPT2, and GPT3.

The position combines deep technical expertise in machine learning with high-impact software development. You'll be responsible for developing and optimizing distributed inference solutions, working directly with compiler and runtime engineers. The role requires expertise in performance tuning for both latency and throughput on large models using Python, PyTorch, or JAX, with a particular focus on Deepspeed and other distributed inference libraries.

As part of Amazon's AWS team, you'll work in a startup-like environment while having the resources and impact of a global tech leader. The team culture emphasizes knowledge-sharing and mentorship, with senior members providing one-on-one mentoring and thorough code reviews. You'll collaborate with internal and external stakeholders, participate in critical design discussions, and directly influence business decisions through technical expertise.

The compensation is highly competitive, ranging from $129,300 to $223,600 based on location, plus additional benefits including equity and sign-on payments. This role offers the unique opportunity to work on cutting-edge ML infrastructure that powers some of the most advanced AI models in production today, making it an ideal position for someone looking to make a significant impact in the field of machine learning systems.

Last updated 3 months ago

Responsibilities For Machine Learning Engineer, AWS Neuron Apps

  • Development, enablement and performance tuning of ML model families
  • Build distributed inference support into PyTorch, TensorFlow using XLA
  • Tune models for highest performance on AWS Trainium and Inferentia silicon
  • Create metrics and implement automation improvements
  • Participate in design discussions and code reviews
  • Work cross-functionally to drive business decisions with technical input

Requirements For Machine Learning Engineer, AWS Neuron Apps

Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Experience with Python, PyTorch or JAX
  • Strong software development skills in C++/Python
  • ML knowledge and experience

Benefits For Machine Learning Engineer, AWS Neuron Apps

Medical Insurance
Equity
  • Full range of medical benefits
  • Financial benefits
  • Total compensation package including equity
  • Sign-on payments

Interested in this job?