Principal Software Engineer

Microsoft develops world-leading AI software and hardware, including the Maia-100 AI accelerator and next-generation supercomputers.
Machine Learning
Principal Software Engineer
Hybrid
5,000+ Employees
12+ years of experience
AI

Description For Principal Software Engineer

The Artificial Intelligence (AI) Frameworks team at Microsoft is at the forefront of developing AI software for training and deploying advanced AI models. Working closely with hardware teams, they build software stacks for next-generation supercomputers and the innovative Maia-100 AI accelerator. The role offers a unique opportunity to work at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software.

As a Principal Software Engineer, you'll be instrumental in developing system software and developer tools for large-scale AI training and inference on novel AI hardware. The position requires extensive software development experience and expertise in C/C++, with opportunities to work on cutting-edge AI technologies. The team maintains a collaborative and inclusive culture, working closely with ML researchers and developers to optimize and scale model training and inference.

The ideal candidate should have strong engineering principles, experience with multicore chip development, and a passion for solving complex technical challenges. This role offers the chance to directly impact Microsoft's AI infrastructure, working with cross-disciplinary teams and contributing to next-generation AI accelerator features. The position combines technical leadership with hands-on development, requiring both strong architectural vision and practical implementation skills.

Last updated a month ago

Responsibilities For Principal Software Engineer

  • Identify requirements, scope solutions, estimate work, schedule deliverables
  • Apply strong engineering principles for defining robust and maintainable architectures and designs
  • Collaborate across multiple disciplines from hardware designers, tool developers, performance analysis and ML application developers
  • Perform software development in C/C++, C#, Python, and other languages
  • Own next gen features of Microsoft AI accelerator

Requirements For Principal Software Engineer

Python
Linux
  • B.S. or advanced degree in computer engineering, computer science, or related fields
  • 12+ years of software development experience
  • 5+ years experience with C/C++
  • Strong technical background in software engineering principles and architecture design
  • Experience in developing SW/FW for multicore chips
  • Strong communication skills
  • Experience with AI development environments (CUDA/PyTorch/TensorFlow)

Benefits For Principal Software Engineer

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer

Principal Software Engineer

Principal Software Engineer role at Microsoft Security, leading AI platform development for Security Copilot, focusing on LLMs and security solutions.

Principal Applied Scientist, Advertiser Copilot

Principal Applied Scientist position at Microsoft leading the development of Copilot Chat Assistant for advertisers, focusing on LLMs and advanced AI technologies.

Principal Software Engineer

Principal Software Engineer position at Microsoft's Turing Team, building enterprise Copilot solutions with focus on AI and machine learning technologies.

Principal Applied AI Engineer Manager

Lead AI innovation and team development at Microsoft Security, developing cutting-edge AI solutions for data security and compliance using LLMs and deep learning.

Principal Software Engineer

Principal Software Engineer role at Microsoft's AI Platform organization, building large-scale AI infrastructure and services for Azure ML and OpenAI.