Lead Software Engineer - Big Data Infrastructure

The Walt Disney Company is a leading diversified international family entertainment and media enterprise.
$152,200 - $223,600
Data
Staff Software Engineer
In-Person
5,000+ Employees
7+ years of experience
Enterprise SaaS · Entertainment

Description For Lead Software Engineer - Big Data Infrastructure

Disney Entertainment & ESPN Product & Technology (DEEP&T) is seeking a Lead Software Engineer to join their Big Data Infrastructure team. This role is crucial in managing big data services such as Hadoop, Spark, Flink, Presto, and Hive across data centers and Cloud environments. The position involves working with distributed systems supporting large-scale data operations and thousands of physical resources.

The ideal candidate will have extensive experience in mission-critical infrastructure and building large-scale data systems. The role focuses on virtualization of big data environments, cost efficiency, resiliency, and performance optimization. You'll be working with cutting-edge technologies and helping shape the future of Disney's media business.

The position offers competitive compensation ranging from $152,200 to $223,600 depending on location and experience, plus additional benefits including bonuses and long-term incentives. You'll be part of a team that powers worldwide advertising and distribution, reaching millions of consumers through platforms like Disney+, Hulu, ABC News, and ESPN.

Key responsibilities include developing and scaling data processing engines, investigating new technologies, building cloud-based infrastructure, and leading best practices adoption. The role requires strong technical expertise in big data technologies, excellent collaboration skills, and the ability to influence system design across teams.

This is an opportunity to join a company that's reimagining entertainment experiences while working on systems that operate at massive scale. You'll be part of Disney's journey in transforming their media business for the future, working with world-class teams and technologies.

Last updated 12 days ago

Responsibilities For Lead Software Engineer - Big Data Infrastructure

  • Develop, scale, and improve large-scale data processing engines
  • Investigate new big data technology and apply it to production environment
  • Build next-gen cloud-based big data infrastructure
  • Handle architectural and design considerations
  • Advocate engineering best practices
  • Work with other engineering teams on big data system design
  • Define and lead adoption of best practices
  • Collaborate with Product Managers to build datastores as a service

Requirements For Lead Software Engineer - Big Data Infrastructure

Kubernetes
Python
Java
  • At least 7 years of professional programming and design experience
  • Experience with big data components (HDFS, HBase, Yarn, Hive, Spark, etc)
  • Experience in building in-house big data infrastructure
  • Experience in developing and optimizing ETL and ad-hoc query engines
  • Experience in CICD, metrics, security and compliance
  • Experience in latest data formats (Iceberg, Delta, Hudi)
  • Bachelor's degree in computer science or related field

Benefits For Lead Software Engineer - Big Data Infrastructure

Medical Insurance
  • Bonus
  • Medical Benefits
  • Long-term Incentives

Interested in this job?

Jobs Related To Disney Lead Software Engineer - Big Data Infrastructure

Lead Data Engineer

Lead Data Engineer position at Disney focusing on data pipeline development, technical leadership, and analytics infrastructure for Parks & Resorts and Entertainment segments.

Manager, Business information & Analysis

Lead business information and analysis at Disney Experiences, overseeing data strategy, analytics, and program management for digital guest experiences.

Lead Data Engineer - Subscriber Solutions

Lead Data Engineer position at Disney focused on building data products and pipelines for subscriber analytics and metrics.

Manager, Software Engineering – Media and Playback Data Processing

Manager position leading software engineering teams for Disney's media and playback data processing, focusing on scalable data solutions and ETL pipelines.

Lead Data Engineer - Data Reliability

Lead Data Engineer position at Disney focusing on data reliability and pipeline infrastructure management.