Software Engineer II (GPU Performance)

Microsoft develops AI software for training and deploying advanced AI models, building software stacks for supercomputers and AI accelerators.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II (GPU Performance)

Microsoft's AI Frameworks team is seeking a Software Engineer II specialized in GPU Performance to join their cutting-edge development team. This role is integral to developing AI software used in training and deploying world's most advanced AI models, working directly with Microsoft's next-generation supercomputers and the new Maia-100 AI accelerator.

The position offers a unique opportunity to work at the intersection of high-performance computing and artificial intelligence, collaborating directly with OpenAI on models hosted on the Azure OpenAI service. The role demands expertise in GPU optimization and performance analysis, requiring hands-on development skills in languages like C/C++, CUDA, and ROCm.

As a Software Engineer II, you'll be responsible for optimizing machine learning models, developing new GPU kernels, and working with state-of-the-art LLMs. The position offers a competitive salary range of $98,300 - $193,200, comprehensive benefits, and the flexibility of hybrid work with up to 50% work from home option.

The ideal candidate will have at least 2 years of technical engineering experience, strong background in GPU optimization, and experience with deep learning frameworks. This role provides an exceptional opportunity to work with cutting-edge AI technology while contributing to Microsoft's mission of empowering every person and organization on the planet to achieve more.

Working at Microsoft means joining a culture that values diversity, inclusion, and innovation, with access to industry-leading healthcare, educational resources, and comprehensive benefits. The role offers significant growth potential within one of the world's leading technology companies, working on projects that shape the future of AI technology.

Last updated 2 months ago

Responsibilities For Software Engineer II (GPU Performance)

  • Software development in C/C++, Python, and GPU languages such as CUDA, ROCm, or Triton
  • Work with cutting-edge hardware stacks and fast-moving software stack
  • Deliver best-of-class inference and optimal cost
  • Engage with key partners for performance analysis and optimization of state-of-the-art LLMs
  • Implement performance analysis and optimization for AI models

Requirements For Software Engineer II (GPU Performance)

Python
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in C/C++, CUDA, or ROCm
  • 1+ years practical experience working on GPU applications and optimization
  • Experience in low-level performance analysis and optimization
  • Proficiency using GPU profiling tools
  • Technical background in software engineering principles and architecture design
  • Experience with deep learning frameworks like PyTorch, Tensorflow, or ONNX Runtime

Benefits For Software Engineer II (GPU Performance)

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer II (GPU Performance)

Software Engineer II

Software Engineer II position at Microsoft focusing on machine learning and SAP workload optimization for Azure platform, offering competitive salary and remote work options.

Machine Learning Engineer

Microsoft ML Engineer role focusing on AI model evaluation platform development, offering remote work and competitive pay range of $81,900-$160,200.

Software Engineer II

Software Engineer II position at Microsoft's Azure AI Platform team, focusing on machine learning and AI development with 3+ years of experience required.

Software Engineer II

Microsoft seeks Software Engineer II for AI Frameworks team to optimize LLM performance and develop AI software solutions across platforms.

Software Engineer 2- AI Tooling

Microsoft seeks a Software Engineer II to develop AI tooling products, requiring 3+ years of experience and expertise in machine learning and cloud technologies.