Senior Software Engineer (GPU Performance)

Microsoft develops AI software for training and deploying advanced AI models, building software stacks for supercomputers and AI accelerators.
$117,200 - $229,200
Machine Learning
Senior Software Engineer
Hybrid
5,000+ Employees
4+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer (GPU Performance)

Microsoft's AI Frameworks team is seeking a Senior Software Engineer specialized in GPU Performance to join their cutting-edge development team. This role is at the forefront of AI technology, working on the software that powers the world's most advanced AI models and Microsoft's next-generation supercomputers, including the new Maia-100 AI accelerator.

The position offers a unique opportunity to work directly with OpenAI on models hosted on the Azure OpenAI service, focusing on performance analysis and optimization of machine learning models. The role requires exceptional software development skills and a proven track record of solving complex technical challenges in building end-to-end AI stacks.

As a Senior Software Engineer, you'll be responsible for developing in C/C++, Python, and GPU languages like CUDA and ROCm, working with state-of-the-art hardware and software stacks to optimize performance for large language models. The role offers competitive compensation ranging from $117,200 to $229,200 per year, with higher ranges for specific locations like the San Francisco Bay area and New York City.

Microsoft provides an inclusive work environment that values diversity and different perspectives, offering comprehensive benefits including industry-leading healthcare, educational resources, parental leave, and investment opportunities. The position is hybrid, allowing up to 50% work from home, based in Redmond, Washington.

The ideal candidate will have 4+ years of technical engineering experience, strong GPU optimization skills, and experience with deep learning frameworks. This is an exceptional opportunity to work on fundamental AI infrastructure that powers some of the most advanced AI systems in the world, while being part of Microsoft's mission to empower every person and organization on the planet to achieve more.

Last updated 2 days ago

Responsibilities For Senior Software Engineer (GPU Performance)

  • Software development in C/C++, Python, and GPU languages such as CUDA, ROCm, or Triton
  • Work with cutting-edge hardware stacks and fast-moving software stack
  • Deliver best-of-class inference and optimal cost
  • Engage with key partners for performance analysis and optimization of state-of-the-art LLMs
  • Implement performance analysis and optimization for state-of-the-art LLMs and other models

Requirements For Senior Software Engineer (GPU Performance)

Python
Linux
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience
  • Experience with C/C++, CUDA, or ROCm
  • 3+ years practical experience working on applications that use GPUs
  • Experience in optimizing GPU performance
  • Practical experience writing new GPU kernels
  • Experience in low-level performance analysis and optimization
  • Proficiency using GPU profiling tools
  • Technical background in software engineering principles and architecture design

Benefits For Senior Software Engineer (GPU Performance)

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Senior Software Engineer (GPU Performance)

Senior Software Engineer, Responsible AI

Senior Software Engineer position at Microsoft focusing on Responsible AI development, implementing ethical AI solutions at scale with competitive compensation and hybrid work arrangement.

Senior Software Engineer

Senior Software Engineer role at Microsoft, focusing on AI-driven shopping catalog development with deep learning, LLM, and NLP technologies.

Senior Software Engineer

Senior Software Engineer role at Microsoft's AI Frameworks team, developing AI software for various platforms from supercomputers to mobile devices.

Senior Applied AI Engineer

Senior Applied AI Engineer position at Microsoft, focusing on developing AI solutions for cybersecurity and defense, offering competitive salary and remote work options.

Senior Machine Learning Engineer

Senior Machine Learning Engineer role at Microsoft focusing on developing industry-leading ML solutions and working with researchers to implement novel algorithms.