Software Engineer II (GPU Performance)

Microsoft develops AI software for training and deploying advanced AI models, building software stacks for supercomputers and AI accelerators.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II (GPU Performance)

Microsoft's AI Frameworks team is seeking a Software Engineer II specialized in GPU Performance to join their cutting-edge development team. This role is integral to developing AI software used in training and deploying world's most advanced AI models, working directly with Microsoft's next-generation supercomputers and the new Maia-100 AI accelerator.

The position offers a unique opportunity to work at the intersection of high-performance computing and artificial intelligence, collaborating directly with OpenAI on models hosted on the Azure OpenAI service. The role demands expertise in GPU optimization and performance analysis, requiring hands-on development skills in languages like C/C++, CUDA, and ROCm.

As a Software Engineer II, you'll be responsible for optimizing machine learning models, developing new GPU kernels, and working with state-of-the-art LLMs. The position offers a competitive salary range of $98,300 - $193,200, comprehensive benefits, and the flexibility of hybrid work with up to 50% work from home option.

The ideal candidate will have at least 2 years of technical engineering experience, strong background in GPU optimization, and experience with deep learning frameworks. This role provides an exceptional opportunity to work with cutting-edge AI technology while contributing to Microsoft's mission of empowering every person and organization on the planet to achieve more.

Working at Microsoft means joining a culture that values diversity, inclusion, and innovation, with access to industry-leading healthcare, educational resources, and comprehensive benefits. The role offers significant growth potential within one of the world's leading technology companies, working on projects that shape the future of AI technology.

Last updated 21 hours ago

Responsibilities For Software Engineer II (GPU Performance)

  • Software development in C/C++, Python, and GPU languages such as CUDA, ROCm, or Triton
  • Work with cutting-edge hardware stacks and fast-moving software stack
  • Deliver best-of-class inference and optimal cost
  • Engage with key partners for performance analysis and optimization of state-of-the-art LLMs
  • Implement performance analysis and optimization for AI models

Requirements For Software Engineer II (GPU Performance)

Python
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in C/C++, CUDA, or ROCm
  • 1+ years practical experience working on GPU applications and optimization
  • Experience in low-level performance analysis and optimization
  • Proficiency using GPU profiling tools
  • Technical background in software engineering principles and architecture design
  • Experience with deep learning frameworks like PyTorch, Tensorflow, or ONNX Runtime

Benefits For Software Engineer II (GPU Performance)

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer II (GPU Performance)

Machine Learning Engineer II

Microsoft is hiring a Machine Learning Engineer II to work on Azure AI's evaluation platform, focusing on NLP and Deep Learning models with competitive compensation and benefits.

Software Engineer 2 - AI Frameworks Team

Software Engineer role at Microsoft's AI Frameworks team, developing advanced AI software and systems with focus on ML infrastructure and developer productivity.

Software Engineer II

Software Engineer II role at Microsoft's Bing Multimedia Team focusing on AI-driven image search and recommendation systems.

Software Engineer II

Software Engineer II position at Microsoft working on AI frameworks and tools, developing ONNX and PyTorch implementations with competitive compensation.

Software Engineer II

Software Engineer II position at Microsoft working on AI frameworks and machine learning optimization