Principal Software Engineer

Microsoft is a company where passionate innovators come to collaborate, building the end-to-end Azure AI stack and core Azure services.
$161,600 - $286,200
Machine Learning
Principal Software Engineer
Remote
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS · Cloud

Description For Principal Software Engineer

Microsoft's AI Platform organization is seeking a Principal Software Engineer to join their Azure ML team, which is core to Azure's innovation and differentiation. This role involves working on Azure OpenAI, Azure ML, Cognitive Services, and global Azure AI infrastructure. The position offers an opportunity to work on large-scale AI workloads and contribute to Microsoft's mission of empowering every person and organization globally.

The role requires expertise in building and maintaining large-scale distributed systems, particularly focused on AI infrastructure. You'll be working with cutting-edge technologies including Kubernetes, Go, Rust, and Python, while designing and implementing solutions for AI training and inferencing at scale. The position combines technical leadership with hands-on development, requiring both deep technical expertise and the ability to mentor team members.

Microsoft offers a competitive compensation package, with base salary ranging from $161,600 to $286,200 (higher in SF and NYC areas), along with comprehensive benefits. The company promotes a culture of inclusion and innovation, seeking diverse perspectives to better serve their customers. This remote-friendly position offers the flexibility of up to 100% work from home, with some travel required (0-25%).

The ideal candidate will bring extensive experience in software engineering, particularly in distributed systems and AI infrastructure, combined with strong leadership abilities and a collaborative mindset. This is an excellent opportunity for someone looking to make a significant impact in the AI and cloud computing space while working with industry-leading technologies and talented teams.

Last updated 4 days ago

Responsibilities For Principal Software Engineer

  • Work on architecture, design, and development of core AI Infrastructure services
  • Design, develop, test, and maintain Kubernetes clusters and data-plane services
  • Enhance systems for high stability, efficiency, maintainability, and security
  • Provide operational support and DRI responsibilities
  • Develop understanding of machine learning systems and customer usage
  • Collaborate with engineers, data scientists, and research teams
  • Provide technical leadership to team members
  • Help grow talent in these areas

Requirements For Principal Software Engineer

Go
Python
Rust
Kubernetes
Linux
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience
  • 5+ years of experience with Linux, container orchestration technologies (K8/Docker)
  • 5+ years of experience building large-scale distributed systems and services
  • 2+ years of experience designing/building AI Infrastructure for large-scale AI Training
  • Must pass Microsoft Cloud Background Check

Benefits For Principal Software Engineer

Medical Insurance
Dental Insurance
Vision Insurance
Parental Leave
401k
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer

Principal Applied Scientist, Advertiser Copilot

Principal Applied Scientist position at Microsoft leading the development of Copilot Chat Assistant for advertisers, focusing on LLMs and advanced AI technologies.

Principal Software Engineer

Principal Software Engineer position at Microsoft's Turing Team, building enterprise Copilot solutions with focus on AI and machine learning technologies.

Principal Applied AI Engineer Manager

Lead AI innovation and team development at Microsoft Security, developing cutting-edge AI solutions for data security and compliance using LLMs and deep learning.

Principal Software Engineer

Principal Software Engineer role at Microsoft's AI Platform team, focusing on Azure ML and AI infrastructure development with competitive compensation and remote work options.

Principal Software Engineer- Machine Learning

Principal Software Engineer role at Microsoft focusing on Machine Learning innovation, GPU computing, and AI platform development with industry-leading benefits and remote work options.