Senior Software Engineer

Microsoft's Azure Machine Learning team is seeking a Senior Software Engineer to join their Inference team, specifically working on the Front Door team. This role is crucial in building and maintaining the model-serving platform for large models, including OpenAI generative models. The position offers an exciting opportunity to work at the intersection of AI and Cloud, serving billions of requests per day.

The role involves designing and implementing highly reliable platform capabilities for model inferencing at scale, with a focus on high throughput and low latency scenarios. You'll be working with cutting-edge AI technology, handling inference requests post model creation and deployment, and managing multi-tenant ingress services.

As a Senior Software Engineer, you'll lead architectural designs, conduct code reviews, solve complex technical challenges, and drive cross-team projects. The position requires strong expertise in C++ and experience with high-scale services. You'll be part of an on-call rotation and work in a hybrid environment with up to 50% work from home flexibility.

Microsoft offers comprehensive benefits including industry-leading healthcare, educational resources, parental leave, and investment opportunities. This is an excellent opportunity for experienced engineers passionate about AI and cloud computing to make a significant impact in a rapidly evolving field.