Principal Software Engineer - GPU Performance

Microsoft builds end-to-end Azure AI stack and Platform as a Service, core to Azure's innovation and all Microsoft's flagship products.
$161,600 - $286,200
Machine Learning
Principal Software Engineer
Remote
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Principal Software Engineer - GPU Performance

Microsoft's AI Platform organization is seeking a Principal Software Engineer to work on GPU performance analysis and optimization. This role is part of the team building Azure OpenAI, Azure Machine Learning, Cognitive Services, and global Azure AI infrastructure. The position involves working with state-of-the-art AI models, collaborating with hardware teams and partners to build software stacks for Microsoft's next-generation supercomputers and the Maia-100 AI accelerator. The ideal candidate will have strong expertise in GPU optimization, C/C++ development, and experience with large-scale AI systems. The role offers the opportunity to work on fundamental abstractions, programming models, and APIs for AI hardware, with direct collaboration with OpenAI. Microsoft provides a competitive compensation package, comprehensive benefits, and a culture focused on inclusion and innovation. The position allows for up to 100% remote work with some travel requirements (0-25%). This is a technical leadership role requiring hands-on software design and development skills, perfect for someone passionate about solving complex AI infrastructure challenges.

Last updated 7 days ago

Responsibilities For Principal Software Engineer - GPU Performance

  • Collaborate across multiple disciplines from hardware designers to ML developers
  • Engage with partners to implement performance analysis and optimization for LLMs
  • Perform software development in C/C++, Python, and GPU development (CUDA, ROCm, Triton)
  • Identify requirements, scope solutions, estimate work, schedule deliverables

Requirements For Principal Software Engineer - GPU Performance

Python
  • Bachelor's Degree in Computer Science or related technical discipline
  • 8+ years technical engineering experience
  • 4+ years experience with C/C++
  • 4+ years practical experience working with GPU applications
  • Experience in optimizing GPU kernels for performance
  • Pass Microsoft Cloud background check

Benefits For Principal Software Engineer - GPU Performance

Medical Insurance
Education Budget
Parental Leave
Mental Health Assistance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer - GPU Performance

Principal Software Engineer

Principal Software Engineer role at Microsoft focusing on optimizing LLMs and Diffusion models for Azure Machine Learning, offering competitive pay and remote work options.

Principal Software Engineer

Principal Software Engineer role at Microsoft's AI Frameworks team, developing AI software and systems across various platforms with competitive compensation and benefits.

Principal Software Engineer

Principal Software Engineer role at Microsoft's Core AI division, focusing on building developer tools and SDK support for LLM technology providers.

Principal Research Software Engineer

Principal Research Software Engineer position at Microsoft Research AI Frontiers, focusing on developing cutting-edge AI technologies and foundation models.

Principal Applied Scientist, Advertiser Copilot

Lead AI development for Microsoft Advertising Platform's Copilot Chat Assistant, focusing on LLMs and advanced AI technologies to enhance advertiser experience.