Software Engineer, Performance, AI Infrastructure
Description For Software Engineer, Performance, AI Infrastructure
Tesla is seeking a Senior Software Engineer to join their AI Infrastructure team, focusing on performance optimization of neural network training systems for both Autopilot and Humanoid robot projects. This role is central to Tesla's autonomy initiatives, working with state-of-the-art GPU clusters and the upcoming Dojo supercomputer. The position demands expertise in CUDA programming, deep learning frameworks, and high-performance computing. You'll be responsible for optimizing training efficiency, reducing model convergence time, and maximizing hardware utilization across large-scale GPU clusters. The role offers competitive compensation ranging from $104,000 to $360,000 annually, plus comprehensive benefits including medical, dental, and vision coverage, 401(k) matching, and stock purchase options. This is an exceptional opportunity to work at the forefront of AI and autonomous systems, contributing to Tesla's mission of accelerating the world's transition to sustainable energy while working with cutting-edge technology and a world-class team.
Responsibilities For Software Engineer, Performance, AI Infrastructure
- Reduce wall clock time to convergence of training jobs by identifying bottlenecks in the ML stack
- Integrate efficient, low-level code with the overall high-level training framework
- Profile workloads and implement solutions to increase training efficiency
- Optimize workloads for efficient hardware utilization (CPU and GPU compute, data throughput, networking)
Requirements For Software Engineer, Performance, AI Infrastructure
- Extensive experience in CUDA kernel programming and pushing GPUs to their limits
- Experience programming in Python
- Experience with at least one deep learning framework (ideally in PyTorch)
- Demonstrated experience in profiling CPU/GPU code
- Proficient in system-level software, hardware-software interactions and resource utilization
- Good knowledge of CUDA kernels used in training state-of-the-art deep learning models
- Experience with high-performance networking (e.g. Infiniband, RDMA, NCCL)
- Experience with Triton (preferred)
Benefits For Software Engineer, Performance, AI Infrastructure
- Medical insurance with $0 payroll deduction options (Aetna PPO and HSA plans)
- Family-building, fertility, adoption and surrogacy benefits
- Dental and vision plans with $0 paycheck contribution options
- Company Paid HSA Contribution
- Healthcare and Dependent Care FSA
- LGBTQ+ care concierge services
- 401(k) with employer match
- Employee Stock Purchase Plans
- Company paid Basic Life, AD&D, short-term and long-term disability insurance
- Employee Assistance Program
- Sick and Vacation time
- Back-up childcare and parenting support
- Commuter benefits
- Employee discounts and perks program
Jobs Related To Tesla Software Engineer, Performance, AI Infrastructure
