Software Engineer II (GPU Performance)

Microsoft develops AI software and hardware, working on next-generation supercomputers and the Maia-100 AI accelerator, collaborating with OpenAI.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II (GPU Performance)

Microsoft's AI Frameworks team is at the forefront of artificial intelligence development, creating software that powers the world's most advanced AI models. This role offers an exciting opportunity to work on GPU performance analysis and optimization for next-generation supercomputers and the innovative Maia-100 AI accelerator.

As a Software Engineer II focusing on GPU Performance, you'll be part of a team that develops fundamental abstractions, programming models, runtimes, libraries, and APIs for large-scale AI model training and inference. The position involves direct collaboration with OpenAI on models hosted on the Azure OpenAI service, making it an exceptional opportunity to work with cutting-edge technology.

The role requires strong technical expertise in GPU optimization and software development, with hands-on experience in C/C++, CUDA, or ROCm. You'll be working in a fast-paced environment where entrepreneurial spirit and initiative are highly valued. The position offers competitive compensation ranging from $98,300 to $193,200 per year, with additional benefits including comprehensive healthcare, educational resources, and parental leave.

Microsoft's commitment to diversity and inclusion creates an environment where different perspectives are not just welcomed but actively sought out. The company's mission to empower every person and organization on the planet provides a meaningful context for your work. You'll be contributing to projects that directly impact the future of AI technology while working with some of the industry's brightest minds.

This is an ideal role for someone who thrives on solving complex technical challenges and wants to make a significant impact in the field of AI acceleration and optimization. The hybrid work environment (up to 50% work from home) offers flexibility while maintaining collaborative opportunities with the team.

Last updated a day ago

Responsibilities For Software Engineer II (GPU Performance)

  • Software development in C/C++, Python, and GPU languages such as CUDA, ROCm, or Triton
  • Work with cutting-edge hardware stacks and fast-moving software stack to deliver best-of-class inference and optimal cost
  • Engage with key partners to implement performance analysis and optimization for state-of-the-art LLMs and other models
  • Embody Microsoft's culture and values

Requirements For Software Engineer II (GPU Performance)

Python
Kubernetes
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in C/C++, CUDA, or ROCm
  • 1+ years practical experience working on GPUs and optimizing their performance
  • Experience in low-level performance analysis and optimization
  • Proficiency using GPU profiling tools such as NVIDIA Visual Profiler and NVIDIA Nsight Compute
  • Technical background in software engineering principles and architecture design
  • Experience with deep learning frameworks like PyTorch, Tensorflow, or ONNX Runtime
  • Cross-team collaboration skills

Benefits For Software Engineer II (GPU Performance)

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer II (GPU Performance)

Software Engineer II

Mid-level Software Engineer position at Microsoft's AI Platform team, focusing on AI/DNN frameworks and tools development with 5+ years of experience required.

Software Engineer II

Software Engineer II position at Microsoft's AI Platform organization, building Azure OpenAI and ML services with competitive pay and comprehensive benefits.

Software Engineer 2

Software Engineer position at Microsoft focusing on developing Generative AI services for Security Copilot, requiring 4+ years of experience in cloud services and AI/ML technologies.

Software Engineer II

Microsoft is hiring a Software Engineer II to develop AI software and optimize large language models, offering competitive compensation and benefits.

Software Engineer II

Microsoft is seeking a Software Engineer II to join the Microsoft365 Turing team, focusing on AI and machine learning solutions development.