Senior Software Engineer

Microsoft's Web Data Platform Team is seeking a Senior Software Engineer to help scale their global web index and build Next Gen Unified Schedulers. The role focuses on building hyper-scale distributed systems that efficiently crawl and store tens of billions of URLs daily. You'll work on balancing resource usage while maintaining web content freshness and supporting critical data needs for Large Language Models (LLMs). The position offers an opportunity to work with cutting-edge ML models and distributed platforms at a massive scale.

The team's mission is crucial for Microsoft's web-scale operations, combining distributed systems expertise with machine learning applications. You'll be responsible for developing sophisticated scheduling systems that optimize crawling operations while being mindful of web server loads. This role requires strong technical skills in distributed systems and a deep understanding of scalability challenges.

As a Senior Engineer, you'll collaborate with cross-functional teams, mentor other engineers, and drive technical decisions that impact Microsoft's web data infrastructure. The position offers competitive compensation, comprehensive benefits, and the chance to work on problems that affect billions of users. The hybrid work environment (up to 50% work from home) provides flexibility while maintaining collaborative opportunities.

The role is perfect for someone who is passionate about large-scale distributed systems, has strong coding skills, and wants to work on technology that powers both traditional web services and next-generation AI models. You'll be part of a team that values innovation, continuous learning, and technical excellence, while contributing to Microsoft's mission of empowering every person and organization on the planet.