Principal Software Engineer - GPU Performance

Microsoft builds cloud-enabled solutions and innovative technology products, focusing on AI and enterprise solutions.
$161,600 - $286,200
Machine Learning
Principal Software Engineer
Remote
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Principal Software Engineer - GPU Performance

Microsoft's AI Platform organization is seeking a Principal Software Engineer to join their team working on GPU performance analysis and optimization. This role is part of the team building Azure OpenAI, Azure Machine Learning, Cognitive Services, and global Azure AI infrastructure. The position involves working with state-of-the-art AI models and next-generation supercomputers, including the new Maia-100 AI accelerator.

The role requires deep expertise in GPU optimization, working directly with hardware teams and partners to build software stacks for advanced AI systems. You'll collaborate with ML researchers and developers to optimize and scale model training and inference, including direct work with OpenAI on models hosted on the Azure OpenAI service.

This is a highly technical position requiring hands-on software design and development skills, with a focus on solving complex problems in building end-to-end AI stacks. The ideal candidate will bring an entrepreneurial approach and ability to take initiative in a fast-paced environment.

The position offers competitive compensation, comprehensive benefits, and the opportunity to work on cutting-edge AI technology that impacts Microsoft's flagship products. The role supports up to 100% remote work with some travel requirements (0-25%), providing flexibility while maintaining collaborative opportunities with world-class teams.

Last updated 13 days ago

Responsibilities For Principal Software Engineer - GPU Performance

  • Collaborate across multiple disciplines from hardware designers to ML developers
  • Engage with partners to implement performance analysis and optimization for LLMs
  • Perform software development in C/C++, Python, and GPU development (CUDA, ROCm, Triton)
  • Identify requirements, scope solutions, estimate work, schedule deliverables

Requirements For Principal Software Engineer - GPU Performance

Python
  • Bachelor's Degree in Computer Science or related technical discipline
  • 8+ years technical engineering experience with coding
  • 4+ years experience with C/C++
  • 4+ years practical experience working with GPUs and optimizing GPU kernels
  • Experience in low-level program behavior and proficiency using profiling tools
  • Technical background in software engineering principles and architecture design
  • Must pass Microsoft Cloud Background Check

Benefits For Principal Software Engineer - GPU Performance

Medical Insurance
Education Budget
Parental Leave
Mental Health Assistance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer - GPU Performance

Principal Software Engineer

Principal Software Engineer role at Microsoft focusing on AI-enabled developer tooling experiences and generative AI systems.

Principal Offensive AI Scientist

Principal Applied Scientist role at Microsoft focusing on AI-driven offensive security operations and autonomous defense systems.

Principal Software Engineer

Principal Software Engineer position at Microsoft's Azure Voice AI team, focusing on developing cutting-edge generative voice and avatar AI models.

Principal Software Engineer

Lead Microsoft's Azure AI Platform team in developing large-scale systems for Language Models and GenAI Services, requiring 12+ years of software engineering experience.

Principal Applied Scientist

Principal Applied Scientist role at Microsoft Security AI Research team, focusing on AI-driven autonomous defense systems and security operations.