Senior Software Engineer

The Artificial Intelligence Frameworks team at Microsoft is seeking a Senior Software Engineer to join their cutting-edge AI development efforts. This role is part of the team that develops AI software enabling AI models to run everywhere - from supercomputers to mobile devices. The team is responsible for the inference performance of OpenAI and other state-of-the-art LLM models, serving trillions of inferences daily across major Microsoft products including Office, Windows, Bing, SQL Server, and Dynamics.

As a Senior Software Engineer, you'll work across multiple levels of the AI software stack, including fundamental abstractions, programming models, compilers, runtimes, libraries, and APIs. You'll be responsible for benchmarking and optimizing OpenAI and other LLM models for performance on GPUs and Microsoft hardware, helping achieve Microsoft Azure's capex goals through efficient deployment strategies.

The role requires strong technical expertise in high-performance computing, GPU architecture, and machine learning frameworks. You'll be working with a collaborative team at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. The position offers the opportunity to impact major Microsoft products and services while working with cutting-edge AI technologies.

The ideal candidate should have extensive experience in software engineering, particularly in performance optimization and machine learning systems. You'll need strong collaboration skills as you'll be working closely with both internal teams and external partners. Microsoft offers a culture of inclusion, comprehensive benefits, and the opportunity to work on technologies that impact billions of users worldwide.