Senior Data Engineer

Do you have a passion for data, analytics, insights, and technology? Do you want to be part of a team that has a planet scale impact? We're looking for a talented Data Engineer who wants to get their hands on large and complex datasets and databases, with deep knowledge of SQL database design, distributed systems, and computer science, who's interested in working alongside software engineers and data scientists to build and deploy cutting-edge analytical capabilities and drive business impact.

We are the Windows Servicing and Delivery (WSD) organization, which is a part of the E+D division. Our core mission is to keep customers protected and productive by delivering a seamless and timely servicing experience for our customers in existing and future versions of Windows. Our Customer Focused Engineering (CFE) team is looking for a highly motivated Senior Data Engineer to help us in this mission. You will play a key role analyzing data for Windows security fixes, analyzing data for improving the reliability of the platform, and working on telemetry and data pipeline development for Windows features to light up new scenarios and devices in the Windows ecosystem (PCs, Phones, Servers, SurfaceHub, Hololens, Azure and more). You would be involved in the Enterprise and Security area of Windows Operating System.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities:

• Develop and maintain data pipelines including solutions for data collection, management, and usage.
• Develop and implement solutions for data quality validation and continuous improvement.
• Manage, execute and monitor weekly and monthly production operations; resolve and escalate production issues as appropriate.
• Partner with data scientists, PMs, engineers and business stakeholders globally to understand business and technical requirements, plan and execute projects, and communicate status, risks and issues.
• Perform root cause analysis of system and data issues and develop solutions as required.
• Finding ways to improve products, tools, and processes for long-term benefit for Microsoft and customers.
• Proven design and problem-solving skills, with an emphasis on quality and data engineering excellence.
• Proven communication skills, both verbal and written.
• The ability to work well in a diverse, global, team-focused environment.
• Mentoring junior engineers in the team.

Required Qualifications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling or data engineering work OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling or data engineering work OR equivalent experience.
• Experience with Azure Analytics stack, e.g., Azure Data Lake, Azure Databricks, Azure Data Factory, Azure Synapse, Azure logic apps.
• Proficient in Power BI and Machine Learning experience.
• Proven track record of collaborative development in an agile team environment
• Experience with infrastructure automation technologies like Docker and Kubernetes.
• Experience in SQL, data warehousing and database architecture.
• Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.

Preferred Qualifications:

• 8+ years of professional software development experience.
• Experience building APIs and services using REST is preferred.
• Overall understanding of Azure/Cloud infrastructure is desirable.