Software Engineer II

The Azure Machine Learning (ML) team within Microsoft's Artificial Intelligence (AI) Platform is seeking a Software Engineer II to join their Models-As-A-Service team. This team is at the forefront of large-scale AI inferencing, responsible for building and operating the industry's largest-scale engineering system for Large Language Models (LLMs) and Generative AI Services. They provide serverless access to various third-party models from providers like Mistral AI, Cohere, and Meta.

The role involves working with cutting-edge AI technologies and ensuring the platform can deliver AI capabilities to customers ranging from individual developers to large enterprises. The position offers competitive compensation, with base pay ranging from $98,300 to $193,200 per year (higher in SF and NYC areas), along with comprehensive benefits.

The ideal candidate should have at least 2 years of technical engineering experience, strong analytical skills, and experience in designing high-performance systems. They will be working on designing and developing features for large-scale model inferencing, optimizing AI models, and collaborating with product managers and model providers.

Microsoft offers an inclusive work environment with industry-leading healthcare, educational resources, parental leave, and various other benefits. The position allows for up to 100% work from home with 0-25% travel requirements. This is an excellent opportunity for someone passionate about AI and machine learning to work on cutting-edge technology that impacts users globally.