Software Engineer II

Microsoft's Azure Machine Learning team is seeking a Software Engineer II to join their Inference team, which is responsible for building the model-serving platform for large models, including OpenAI generative models. The role focuses on creating highly reliable and available platforms for model inferencing at scale, serving billions of requests per day for cutting-edge scenarios.

The position offers an exciting opportunity to work at the intersection of AI and Cloud, supporting critical workloads for services like Bing and Office. As a mid-level developer, you'll be integral in designing and implementing features from conception to production deployment, with a focus on high-performance computing and optimization.

The ideal candidate will bring strong software engineering fundamentals with experience in high-throughput, low-latency systems. You'll be part of Microsoft's vision to democratize machine learning, making it accessible to enterprises, developers, and data scientists worldwide. The role offers comprehensive benefits, professional growth opportunities, and the chance to work with cutting-edge AI technologies.

Working in a hybrid environment with up to 50% work from home flexibility, you'll collaborate with talented teams while contributing to Microsoft's mission of empowering every person and organization on the planet to achieve more. The position includes industry-leading benefits, educational resources, and a supportive work culture that values diversity and innovation.