Software Engineer - II

Microsoft is seeking a Software Engineer II to join their Azure Managed Inference team in Hyderabad. This role is at the forefront of AI innovation, building and running the model-serving platform for Generative LLMs at massive scale. The position involves designing and building highly reliable platforms supporting billions of daily inference requests, working with both Azure customers and internal teams like Bing and Office.

The ideal candidate will have 4+ years of experience with a strong background in distributed systems, cloud computing, and AI/ML technologies. They'll be responsible for developing high-performance ML workloads, ensuring service reliability, and maintaining production systems. The role offers a unique opportunity to work at the intersection of AI and Cloud computing, solving complex technical challenges while supporting Microsoft's mission to democratize AI.

The position offers comprehensive benefits including healthcare, educational resources, parental leave, and investment options. Working in a hybrid model with up to 50% work from home flexibility, you'll be part of a global team driving innovation in AI technology. This is an excellent opportunity for engineers passionate about large-scale systems and AI to make a significant impact in the field.