Senior Software Engineer- GPU

Microsoft develops AI software and cloud services, empowering every person and organization on the planet to achieve more.
$117,200 - $250,200
Machine Learning
Senior Software Engineer
Remote
5,000+ Employees
4+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer- GPU

Microsoft's AI Frameworks team is seeking a Senior Software Engineer specializing in GPU optimization to join their cutting-edge AI development efforts. This role sits at the intersection of AI innovation and hardware optimization, working directly with OpenAI and other state-of-the-art Large Language Models.

The position involves developing AI software that enables running AI models across various platforms, from supercomputers to mobile devices. You'll be responsible for optimizing inference performance of OpenAI models and working on multiple levels of the AI software stack, including fundamental abstractions, programming models, compilers, and runtimes.

The ideal candidate will have strong experience in high-performance computing, GPU optimization, and deep learning frameworks. You'll work with technologies like PyTorch, TensorFlow, and CUDA, while collaborating with researchers and developers to optimize and scale model training and inference.

This role offers the opportunity to impact major Microsoft products including Office, Windows, Bing, and SQL Server, serving trillions of inferences per day. You'll be part of a team that's pushing the boundaries of AI acceleration and optimization, working with both software and hardware teams to build the future of AI infrastructure.

The position comes with competitive compensation, comprehensive benefits, and the chance to work on some of the most challenging problems in AI computing. Microsoft offers a collaborative, inclusive work environment with a growth mindset culture, making it an ideal place for engineers passionate about AI and high-performance computing.

Working at Microsoft means joining a company committed to empowering others and achieving ambitious goals. You'll have access to world-class resources, leading-edge technology, and the opportunity to shape the future of AI computing while working with some of the best minds in the industry.

Last updated 2 hours ago

Responsibilities For Senior Software Engineer- GPU

  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPU's and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling
  • Enable fast time to market LLMs/models and their deployments at scale
  • Design, implement, and test functions or components for AI/DNN/LLM frameworks and tools
  • Speed up/reduce complexity of key components/pipelines
  • Communicate and collaborate with internal and external partners

Requirements For Senior Software Engineer- GPU

Python
Java
JavaScript
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience
  • 2+ years practical experience working on High Performance Applications and Performance Debug and Optimization on CPU's/GPU's
  • Technical background in software engineering principles, computer architecture, GPU architecture
  • Experience in end-to-end performance analysis and optimization of state-of-the-art LLMs
  • Experience in DNN/LLM inference and experience in DL frameworks
  • Cross-team collaboration skills
  • Experience in working with orchestration platforms like K8 and Service Fabric

Benefits For Senior Software Engineer- GPU

Medical Insurance
Education Budget
Parental Leave
Mental Health Assistance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Senior Software Engineer- GPU

Senior Applied AI Engineer

Senior Applied AI Engineer role at Microsoft Security, focusing on developing autonomous agents and AI systems for cybersecurity, with competitive pay and remote work options.

Software Engineer- AI Full Stack Development

Senior Software Engineer role at Microsoft focusing on AI and full-stack development, requiring 4+ years of experience and expertise in AI/ML technologies.

Senior Software Engineer

Senior Software Engineer role at Microsoft focusing on AI-enabled developer tools, offering remote work and competitive compensation.

Senior Software Engineer-Machine Learning Frameworks

Senior Software Engineer role at Microsoft focusing on developing and optimizing machine learning frameworks through the DeepSpeed open-source library.

Senior Software Engineer- AI Compilers

Senior Software Engineer position at Microsoft focusing on AI compiler development, requiring expertise in C++, Python, and compiler frameworks with 4+ years of experience.