Senior Telemetry Data Engineer
Description For Senior Telemetry Data Engineer
Microsoft's Cloud Operations + Innovation (CO+I) team is seeking a Senior Telemetry Data Engineer to join their Critical Environment Systems Intelligence (CESI) team. This role is crucial in powering Microsoft's core cloud platforms and services used by millions daily, including 95% of Fortune 500 businesses on Azure and 180 million Office 365 users.
As a Senior Data Engineer, you'll be responsible for designing and delivering solutions to support global datacenter operations and improve availability. You'll work with massive amounts of data, implementing low-latency solutions across cutting-edge technologies. The role involves partnering with other CO+I teams to monitor, detect, and alert on data center critical environment mechanical and electrical resources.
The position offers the opportunity to work with advanced technologies including machine learning models for anomaly detection, data lakes within Lakehouse architectures, and real-time data streaming systems. You'll be instrumental in driving CO+I's transition to a customer-centric, data-driven, observability-based live service culture.
Key responsibilities include implementing telemetry data ingestion systems, developing multi-signal anomaly detection systems, and ensuring high-coverage mapping of leased site signals. You'll work with various environmental monitoring systems and be responsible for creating efficient data processing pipelines.
The ideal candidate will have expertise in machine learning, data engineering, and cloud computing, with strong programming skills in Python, GoLang, or similar languages. Experience with Kusto Query Language (KQL) and understanding of data center operations is highly valued.
This role offers the opportunity to work remotely with up to 25% travel, providing flexibility while maintaining connection with the team. You'll be part of Microsoft's inclusive work environment and have access to comprehensive benefits including healthcare, educational resources, and investment opportunities.
Join Microsoft in their mission to empower every person and organization on the planet to achieve more, while working with cutting-edge technology and contributing to the reliability of global cloud infrastructure.
Responsibilities For Senior Telemetry Data Engineer
- Drive end-to-end monitoring and processing of critical environment infrastructure telemetry
- Design and implement telemetry data ingestion and processing systems
- Prototype, pilot, and deploy multi-signal anomaly detection systems
- Define and drive operationalization plan for telemetry pipeline
- Ensure interoperability of detection methods and systems
- Understand signals from EPMS and BAS systems
- Ensure high coverage of leased site signals
- Define reusable primitives for mapping topology of data centers
- Implement high-frequency, low-latency streaming pipeline
Requirements For Senior Telemetry Data Engineer
- Subject matter expertise in supervised and unsupervised machine learning models for anomaly detection
- Expertise in utilizing data lakes within Lakehouse architectures
- Advanced proficiency in Kusto Query Language (KQL), Python, GoLang, or Spark
- Experience with generative AI or Copilots
- Expertise in processing data frames from networking layers and protocols
- Bachelor's or master's degree in computer science, data engineering, or related field
- Excellent problem-solving skills and attention to detail
- Strong written and verbal communication skills
Benefits For Senior Telemetry Data Engineer
- Industry leading healthcare
- Educational resources
- Discounts on products and services
- Savings and investments
- Maternity and paternity leave
- Generous time away
- Giving programs
- Opportunities to network and connect
Jobs Related To Microsoft Senior Telemetry Data Engineer
