Senior Software Engineer (GPU Performance)

Microsoft develops software and services, including AI frameworks used to train and deploy advanced AI models.
$117,200 - $229,200
Machine Learning
Senior Software Engineer
Remote
5,000+ Employees
4+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer (GPU Performance)

Microsoft's AI Frameworks team is seeking a Senior Software Engineer specializing in GPU Performance to join their cutting-edge development team. This role is integral to developing AI software used in training and deploying world-class AI models, working directly with Microsoft's next-generation supercomputers and the new Maia-100 AI accelerator. The position offers a unique opportunity to collaborate with OpenAI and work on the Azure OpenAI service.

The role focuses on GPU performance analysis and optimization, requiring strong technical expertise in software development. You'll be working on fundamental abstractions, programming models, runtimes, libraries, and APIs to enable large-scale training and inferencing of models on novel AI hardware. The position demands someone with a proven track record of solving complex technical challenges and the ability to take initiative in building a complete end-to-end AI stack.

As part of Microsoft's inclusive culture, you'll join a team that values diverse perspectives and collaborative innovation. The company offers competitive compensation ($117,200 - $229,200 base salary range) and comprehensive benefits, including healthcare, educational resources, and parental leave. This remote position allows up to 100% work from home with 0-25% travel requirements.

The ideal candidate will bring 4+ years of technical engineering experience, strong proficiency in C/C++, CUDA, or ROCm, and extensive knowledge of GPU optimization. This role presents an exceptional opportunity to work at the forefront of AI technology while contributing to Microsoft's mission of empowering every person and organization on the planet to achieve more.

Last updated 11 hours ago

Responsibilities For Senior Software Engineer (GPU Performance)

  • Software development in C/C++, Python, and GPU languages (CUDA, ROCm, or Triton)
  • Work with cutting-edge hardware stacks and fast-moving software stack
  • Deliver best-of-class inference and optimal cost
  • Engage with key partners for performance analysis and optimization of LLMs
  • Implement performance analysis and optimization for state-of-the-art models

Requirements For Senior Software Engineer (GPU Performance)

Python
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience
  • Experience with C/C++, CUDA, or ROCm
  • 3+ years practical experience working on GPU applications and optimization
  • Experience writing new GPU kernels
  • Experience in low-level performance analysis and optimization
  • Proficiency using GPU profiling tools
  • Technical background in software engineering principles and architecture design
  • Experience with deep learning frameworks like PyTorch, Tensorflow, or ONNX Runtime
  • Cross-team collaboration skills

Benefits For Senior Software Engineer (GPU Performance)

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Senior Software Engineer (GPU Performance)

Senior Machine Learning Engineer

Senior Machine Learning Engineer position at Microsoft, focusing on developing and implementing cutting-edge ML solutions with competitive pay and benefits.

Senior Software Engineer

Senior Software Engineer position at Microsoft's Mixed Reality team, focusing on computer vision and machine learning for mixed reality applications with competitive compensation and benefits.

Senior Software Development Engineer

Senior Software Development Engineer role at Microsoft focusing on machine learning platform development, offering $117,200-$229,200 salary with comprehensive benefits.

Senior Software Engineer

Senior Software Engineer position at Microsoft focusing on Responsible AI and Azure AI Platform development, requiring 8+ years of experience in building scalable AI services.

Senior Software Engineer

Senior Software Engineer role at Microsoft's AI Frameworks team, developing software for advanced AI models and next-gen supercomputers in Vancouver, BC.