Taro Logo

Senior Software Engineer (GPU Performance)

Microsoft develops software and technology solutions, empowering every person and organization on the planet to achieve more.
$117,200 - $229,200
Backend
Senior Software Engineer
Hybrid
5,000+ Employees
4+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Senior Software Engineer (GPU Performance)

Microsoft's Artificial Intelligence (AI) Frameworks team is seeking a Senior Software Engineer specializing in GPU Performance to join their cutting-edge development team. This role is part of the team that develops AI software for training and deploying advanced AI models, working directly with Microsoft's next-generation supercomputers and the new Maia-100 AI accelerator.

The position offers a unique opportunity to work on fundamental abstractions, programming models, runtimes, libraries, and APIs for large-scale AI model training and inference. You'll be collaborating directly with OpenAI on models hosted on the Azure OpenAI service, and working alongside hardware teams and partners to optimize performance.

This technical role requires strong expertise in GPU performance analysis and optimization, with hands-on software development skills in languages like C/C++, CUDA, and ROCm. The ideal candidate should have a proven track record of solving complex technical problems and be ready to tackle challenges in building a complete end-to-end AI stack.

Working in a hybrid environment with up to 50% work from home flexibility, you'll be part of Microsoft's mission to empower every person and organization globally. The role offers competitive compensation ranging from $117,200 to $229,200 per year (higher in SF and NYC areas), along with comprehensive benefits including healthcare, educational resources, and parental leave.

The position requires 4+ years of technical engineering experience, strong GPU optimization skills, and experience with deep learning frameworks. You'll be joining a collaborative environment that values diversity, inclusion, and innovation, working on some of the most advanced AI technologies in the industry.

Last updated 3 months ago

Responsibilities For Senior Software Engineer (GPU Performance)

  • Software development in C/C++, Python, and GPU languages such as CUDA, ROCm, or Triton
  • Work with cutting-edge hardware stacks and fast-moving software stack
  • Deliver best-of-class inference and optimal cost
  • Engage with key partners for performance analysis and optimization of state-of-the-art LLMs
  • Embody Microsoft culture and values

Requirements For Senior Software Engineer (GPU Performance)

Python
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience
  • Experience with C/C++, CUDA, or ROCm
  • 3+ years practical experience working on GPU applications and optimization
  • Experience writing new GPU kernels
  • Experience in low-level performance analysis and optimization
  • Proficiency using GPU profiling tools
  • Technical background in software engineering principles and architecture design
  • Experience with deep learning frameworks like PyTorch, Tensorflow, or ONNX Runtime

Benefits For Senior Software Engineer (GPU Performance)

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?