Software Engineer II

The Artificial Intelligence (AI) Frameworks team at Microsoft develops AI software that enables running AI models everywhere, from world's fastest AI supercomputers, to servers, desktops, mobile phones, IoT devices and internet browsers. We collaborate with our hardware teams and partners, both internal and external, and operate at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software.

As a Software Engineer II on the team, you will have the opportunity to work on multiple levels of the AI software stack, including fundamental abstractions, programming models, compilers, runtimes, libraries and APIs to enable large scale training and inferencing of models. You will benchmark OpenAI and other Large Language Models (LLMs) for performance on GPUs and Microsoft HW, debug and optimize performance, monitor performance and enable these models to be deployed in the shortest amount of time and the least amount of HW possible helping achieve Microsoft Azure's capex goals.

Key responsibilities include:

• Contribute to improving end-to-end inference performance of OpenAI and other state of the art LLMs
• Measure, benchmark performance on Nvidia/AMD GPU's and first party Microsoft silicon
• Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities
• Enable fast time to market of LLMs/models and their deployments at scale
• Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
• Speed up/reduce complexity of key components/pipelines to improve performance and/or efficiency of our systems
• Communicate and collaborate with our partners both internal and external

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to C, C++, or Python OR equivalent experience
• 1+ years' practical experience working on high performance applications and performance debug and optimization on CPU's/GPU's

This role offers a competitive base pay range of USD $98,300 - $193,200 per year across the U.S., with higher ranges for specific locations like the San Francisco Bay area and New York City metropolitan area (USD $127,200 - $208,800 per year).