Principal Software Engineer

Microsoft builds innovative technology solutions to empower every person and organization on the planet to achieve more.
$158,500 - $276,600
Machine Learning
Principal Software Engineer
Remote
5,000+ Employees
10+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Principal Software Engineer, CoreAI

Principal Software Engineer position at Microsoft CoreAI, developing AI-first app stack and leading technical initiatives with competitive compensation and remote work flexibility.

Principal Software Engineer - CoreAI

Principal Software Engineer position at Microsoft's Azure OpenAI team, focusing on AI services development with competitive salary and hybrid work model.

Principal Software Engineer

Principal Software Engineer role at Microsoft Security focusing on AI platform development and security solutions.

Principal Software Engineer

Lead the development of AI software and infrastructure for Microsoft's next-generation supercomputers and AI accelerators, focusing on system software stacks and developer tools.

Principal Software Engineer

Principal Software Engineer position at Microsoft's AI Frameworks team, focusing on developing and optimizing AI software and LLM infrastructure across Microsoft's product ecosystem.

Description For Principal Software Engineer

Microsoft's AI Platform organization is seeking a Principal Software Engineer to join their team building cutting-edge AI infrastructure and solutions. This role is part of the team responsible for Azure OpenAI, Azure Machine Learning, and Cognitive Services, focusing on GPU performance analysis and optimization. The position offers the opportunity to work on fundamental AI software used to train and deploy advanced AI models, collaborating directly with OpenAI and hardware teams on Microsoft's next-generation supercomputers and the Maia-100 AI accelerator.

The role requires deep technical expertise in GPU optimization, software development, and AI/ML systems. You'll be working at the intersection of hardware and software, developing solutions for large-scale AI training and inference. The position offers up to 100% work from home flexibility with 0-25% travel requirements.

As a Principal Engineer, you'll be at the forefront of AI innovation, working with state-of-the-art technologies and contributing to Microsoft's mission of empowering every person and organization on the planet. The role offers competitive compensation, comprehensive benefits, and the opportunity to work on some of the largest AI workloads globally.

The ideal candidate will bring strong technical skills in C/C++, GPU programming, and performance optimization, combined with the ability to collaborate across teams and disciplines. This is an opportunity to shape the future of AI infrastructure while working with industry-leading technologies and experts in the field.

Last updated 19 days ago

Responsibilities For Principal Software Engineer

  • Collaborate broadly across multiple disciplines from hardware designers to ML developers
  • Engage with key partners to understand and implement robust performance analysis and optimization for state-of-the-art LLMs and other models
  • Perform software development in C/C++, Python, and GPU development in languages such as CUDA, ROCm, or Triton
  • Identify requirements, scope solutions, estimate work, schedule deliverables

Requirements For Principal Software Engineer

Python
  • Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience
  • 4+ years' experience with C/C++
  • 4+ years' practical experience working on real-world applications that use GPUs
  • Experience in optimizing GPU kernels for performance
  • Experience in low-level program behavior, including performance and memory usage
  • Proficiency using profiling tools such as NVIDIA Visual Profiler, nvprof, and NVIDIA Nsight Compute
  • Technical background in software engineering principles, architecture design, and performance analysis
  • Exposure to state-of-the art Deep Neural Network training and inference workloads

Benefits For Principal Software Engineer

Medical Insurance
Parental Leave
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?