Principal Software Engineer

Microsoft's Artificial Intelligence (AI) Frameworks team is at the forefront of developing AI software that powers everything from world-class supercomputers to mobile devices. The team is seeking a Principal Software Engineer to join their AI Platform division, working on cutting-edge large language models (LLMs) and AI infrastructure.

The role involves working with state-of-the-art AI technologies, including direct collaboration with OpenAI, and contributing to systems that serve trillions of inferences daily across major Microsoft products. You'll be working at the intersection of AI innovation, hardware optimization, and software development, focusing on performance optimization and scaling of AI models.

As a Principal Software Engineer, you'll be responsible for setting technical direction and hands-on development of the AI stack. The position requires deep expertise in high-performance computing, GPU optimization, and machine learning frameworks. You'll work with technologies like CUDA, ROCm, and Triton, while collaborating with a cross-disciplinary team of researchers and developers.

The role offers the opportunity to make significant impact on Microsoft's AI infrastructure, working with both internal teams and the open-source community. You'll be instrumental in optimizing performance across different hardware platforms, including Nvidia, AMD GPUs, and Microsoft's own silicon solutions. This is an ideal position for someone who combines technical excellence with the ability to drive innovation in AI systems at scale.