Lead Data Engineer

Disney Entertainment & ESPN Technology is seeking a Lead Data Engineer to join their Machine Learning (ML) Engineering team. The role involves developing and improving feature store tooling and services, contributing to ML infrastructure development, and collaborating with ML practitioners to build a streaming data ecosystem. You'll work on event and context processors to federate data, infrastructure, and tooling to enable event-driven ML pipelines. You'll own and expand part of the central feature store that powers ML use cases in domains like recommendations, search, and fraud. This position requires expertise in large-scale, real-time distributed systems, big data pipelines, and cloud technologies. You'll work in an Agile environment, focusing on collaboration and teamwork while driving a culture of quality, innovation, and experimentation.

Key Responsibilities:

• Develop and improve feature store tooling and services
• Contribute to ML infrastructure development
• Collaborate with ML practitioners to build streaming data ecosystem
• Develop low-latency services for event-driven pipelines
• Work on multi-faceted projects across diverse teams
• Drive and maintain a culture of quality, innovation, and experimentation

Basic Qualifications:

• Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or equivalent work experience
• 7+ years of software experience in large scale, real-time distributed systems
• Experience building and deploying big data pipelines in production
• Experience with cloud technologies (AWS or GCP) and container systems (Docker or Kubernetes)
• Passion for building platforms and infrastructure excellence
• Excellent communication and people engagement skills

Preferred Qualifications:

• Familiarity with ML pipelines, data ecosystem, and AWS technologies
• Experience building ML infrastructure and streaming ML applications
• Experience shipping entertainment and media applications for streaming purposes

This role offers the opportunity to work on cutting-edge ML infrastructure and contribute to Disney's media business transformation. You'll be part of a team that reaches millions of consumers daily through products like Disney+, Hulu, ABC News, ESPN, and more. The position also comes with competitive compensation and benefits, including potential bonuses and long-term incentives.