Senior Software Engineer (GPU Performance)

Microsoft's AI Frameworks team is seeking a Senior Software Engineer specializing in GPU Performance to join their cutting-edge initiative in developing AI software for training and deploying advanced models. This role sits at the intersection of hardware and software optimization, working directly with next-generation supercomputers and the innovative Maia-100 AI accelerator.

The position offers a unique opportunity to work on fundamental aspects of AI infrastructure, collaborating directly with OpenAI and contributing to the Azure OpenAI service. The role demands expertise in GPU performance analysis and optimization, with a focus on enabling large-scale training and inferencing of models on novel AI hardware.

As a Senior Software Engineer, you'll be responsible for developing in C/C++, Python, and GPU languages, working with state-of-the-art hardware stacks, and implementing performance optimizations for large language models. The role requires a minimum of 4 years of technical engineering experience, with deep expertise in GPU applications and kernel optimization.

The compensation is competitive, ranging from $117,200 to $229,200 per year, with higher ranges for specific locations like the San Francisco Bay area and New York City. Microsoft offers comprehensive benefits including industry-leading healthcare, educational resources, parental leave, and investment opportunities.

This is an excellent opportunity for someone passionate about AI infrastructure who wants to work at the forefront of technology, directly impacting the development of next-generation AI systems. The role combines technical depth with collaborative opportunities, working alongside researchers and developers in a fast-paced, innovation-driven environment.