Senior Software Engineer

Microsoft is leading the AI strategy to democratize AI, making it an essential ingredient for breakthrough customer experiences and ensuring AI benefits reach everyone safely and responsibly.
Backend
Senior Software Engineer
Hybrid
5,000+ Employees
7+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer

Microsoft's Azure Managed Inference team is seeking a Senior Software Engineer to join their cutting-edge AI platform initiative. This role focuses on building and maintaining a highly reliable platform supporting model inferencing at massive scale - handling billions of requests daily. You'll be working at the intersection of AI and Cloud, supporting both Azure customers and internal Microsoft products like Bing and Office.

The position offers an opportunity to work with Generative LLMs and solve complex problems in distributed computing and high-performance systems. You'll be responsible for designing scalable architectures, ensuring security and performance optimization, and leading technical initiatives that directly impact Microsoft's AI infrastructure.

The ideal candidate brings strong expertise in distributed systems, cloud platforms, and software engineering fundamentals. You'll need to demonstrate proficiency in languages like Python/Java/C#, have experience with cloud platforms, and understand large-scale data processing. The role combines hands-on technical work with leadership responsibilities, including code reviews, incident management, and cross-team collaboration.

This hybrid position offers comprehensive benefits, including industry-leading healthcare, educational resources, and parental leave. You'll be part of Microsoft's mission to democratize AI technology while working with cutting-edge technologies and world-class engineers.

Last updated 6 days ago

Responsibilities For Senior Software Engineer

  • Lead architectural design of complex software systems for model serving
  • Conduct code reviews focusing on high-quality product delivery and security compliance
  • Solve complex technical issues to improve service & customer experience
  • Work as part of an on-call rotation to support services
  • Collaborate with cross-functional and cross-geo teams and stakeholders
  • Embody company culture and values

Requirements For Senior Software Engineer

Python
Java
  • Master's and 5+ years' experience, or Bachelor's and 7+ years' experience in Computer Science, Computer Engineering, or related field
  • Strong hold on Data Structures, algorithmic problem solving and proficiency in software development/engineering skills (Python/Java/C#)
  • Proven Industry experience on large-scale data processing, distributed computing, or cloud platforms
  • Proficiency in Agile development practices and CI/CD
  • Experience with cloud platforms (Azure, AWS) and distributed computing
  • Excellent verbal and written communication skills

Benefits For Senior Software Engineer

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Senior Software Engineer

Senior Software Engineer

Senior Software Engineer role at Microsoft working on AI infrastructure for online advertising, focusing on scalable systems and machine learning solutions.

Windows Support Performance Engineer

Senior Windows Support Engineer position at Microsoft, focusing on advanced troubleshooting and customer support with hybrid work options.

Senior Software Engineer

Senior Software Engineer role at Microsoft Security, working on Copilot for Security with focus on AI and cybersecurity solutions.

Senior Software Engineer

Senior Software Engineer role at Microsoft focusing on hardware security, TPM, and secure processor development for Azure, Windows, and Xbox platforms.

Senior Software Engineer

Senior Software Engineer role at Microsoft focusing on compiler and build system optimization, offering competitive pay and comprehensive benefits.