Senior Software Engineer (GPU Performance)

A global technology company that develops and supports software, consumer electronics, and services.
$108,100 - $199,700
Machine Learning
Senior Software Engineer
Remote
5,000+ Employees
4+ years of experience
AI

Description For Senior Software Engineer (GPU Performance)

Microsoft's AI Frameworks team is seeking a Senior Software Engineer specializing in GPU Performance to join their cutting-edge development efforts. This role is part of the team that develops AI software for training and deploying advanced AI models, working directly with Microsoft's next-generation supercomputers and the new Maia-100 AI accelerator.

The position offers a unique opportunity to work at the intersection of high-performance computing and artificial intelligence, collaborating directly with OpenAI on models hosted on the Azure OpenAI service. The role demands expertise in GPU optimization, performance analysis, and hands-on software development, particularly focusing on scaling and optimizing machine learning models on novel AI hardware.

Based in Vancouver, British Columbia, with up to 100% work-from-home flexibility, this position offers a competitive salary range of CAD $108,100 - $199,700 per year. The role requires 4+ years of technical engineering experience, with specific emphasis on GPU optimization and kernel development.

The successful candidate will be part of Microsoft's mission to empower every person and organization globally, working in an inclusive culture that values growth mindset and innovation. You'll be developing fundamental abstractions, programming models, and APIs while collaborating with ML researchers and developers to optimize and scale model training and inference.

This is an exceptional opportunity for someone passionate about high-performance computing, AI infrastructure, and solving complex technical challenges in a collaborative environment. The role offers comprehensive benefits, including industry-leading healthcare, educational resources, and work-life balance support.

Last updated a day ago

Responsibilities For Senior Software Engineer (GPU Performance)

  • Software development in C/C++, Python, and GPU languages such as CUDA, ROCm, or Triton
  • Work with cutting-edge hardware stacks and fast-moving software stack to deliver best-of-class inference and optimal cost
  • Engage with key partners to understand and implement performance analysis and optimization for state-of-the-art LLMs and other models
  • Embody Microsoft's Culture & Values

Requirements For Senior Software Engineer (GPU Performance)

Python
  • Bachelor's Degree in Computer Science, or related technical discipline AND 4+ years technical engineering experience with coding in languages including C, C++, or Python
  • 3+ years practical experience working on GPU applications and optimizing their performance
  • Practical experience writing GPU kernels
  • Experience with GPU profiling tools such as NVIDIA Visual Profiler and NVIDIA Nsight Compute
  • Technical background in software engineering principles and architecture design
  • Experience with Deep Neural Network inference and deep learning frameworks like PyTorch, Tensorflow, or ONNX runtime
  • Cross-team collaboration skills

Benefits For Senior Software Engineer (GPU Performance)

Medical Insurance
Parental Leave
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Senior Software Engineer (GPU Performance)

Senior Software Engineer - ML Focused

Senior Software Engineer position at Microsoft focusing on Machine Learning and AI implementation, working with GPU technologies and advanced ML algorithms for Windows platform innovations.

Senior Software Engineer

Senior Software Engineer position at Microsoft's Turing team, working on Microsoft365 Copilot and machine learning solutions.

Senior Software Engineer - AI/ML

Senior Software Engineer position at Microsoft focusing on AI/ML development, working on next-generation applications with Dynamics 365, Copilot, and cloud services in Dublin, Ireland.

Senior Software Engineer

Senior Software Engineer position at Microsoft's Azure ML team, focusing on AI and machine learning platform development with competitive compensation and comprehensive benefits.

Senior Software Engineer

Senior Software Engineer position at Microsoft's Azure AI Platform team, focusing on AI infrastructure and LLM services, offering hybrid work in Redmond, WA.