Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Nielsen provides powerful insights that drive client decisions in media measurement and audience engagement across all platforms.
Data
Senior Software Engineer
Hybrid
5,000+ Employees
4+ years of experience
Enterprise SaaS · AI

Description For Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Nielsen, a global leader in media measurement and analytics, is seeking a Senior Data Engineer to join their technology team. This role presents an exciting opportunity to work at the forefront of media measurement technology, helping to power better media futures through data-driven insights.

The position combines big data processing, cloud architecture, and distributed systems expertise, requiring proficiency in technologies like Apache Spark, Scala, and AWS. As a Senior Data Engineer, you'll be responsible for building scalable, reliable, and cost-effective solutions that handle massive datasets and complex analytics pipelines.

The role offers a unique blend of technical challenges and leadership opportunities. You'll work on implementing end-to-end solutions in big data analytics, while also mentoring junior team members and collaborating with data scientists to translate complex methodologies into engineering solutions. The position requires 4-8 years of experience, with at least 3 years focused on big data processing using Apache Spark.

Nielsen offers a hybrid work environment and the chance to work with cutting-edge technologies. You'll be part of a dynamic team that values continuous learning and innovation. The company's strong legacy in media measurement, combined with its forward-thinking approach to technology, makes this an ideal opportunity for a senior engineer looking to make a significant impact in the media analytics space.

Key technical requirements include expertise in Java/Scala, Big Data technologies (Hadoop, Spark, Spark SQL), cloud platforms (preferably AWS), and various data storage solutions (PostgreSQL, Cassandra, Elasticsearch). The role also demands strong problem-solving abilities and excellent communication skills, as you'll be working closely with product owners and cross-functional teams.

This position is perfect for someone who enjoys tackling complex technical challenges while having the opportunity to mentor others and influence technical direction. You'll be at the intersection of big data, cloud computing, and media analytics, helping Nielsen maintain its position as a leader in audience measurement and analytics.

Last updated 4 days ago

Responsibilities For Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

  • Build scalable, reliable, cost-effective solutions for Cloud and on-premises
  • Build and test Cloud-based applications for new and existing backend systems
  • Build platform reusable code and components for multiple project teams
  • Implement end-to-end solutions with sound technical architecture in Big Data analytics framework
  • Drive innovative solutions within the platform
  • Develop design specifications and deployment strategy for Agile methodology
  • Provide cloud integration development support
  • Build rapid technical prototypes
  • Collaborate with Data Science team and product owners
  • Mentor junior team members
  • Stay informed about latest technology trends

Requirements For Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Scala
Java
Python
PostgreSQL
Cassandra
Kafka
  • Bachelor's degree in computer science, engineering with 4-8 years of experience
  • Strong cloud Implementation expertise in cloud architecture
  • Strong analytical and technical skills in troubleshooting
  • 3+ years experience in big data using Apache Spark
  • Experience in AWS Cloud with automation technologies
  • Experience in Java or Scala, Big Data, Hadoop, Spark, Spark SQL
  • Strong knowledge of Unix/Linux OS, commands, shell scripting, python
  • Experience with Apache Airflow or similar tools
  • Strong knowledge in AWS services (S3, EC2, EMR, Lambda)
  • Experience with data warehouses or data lakes
  • Very strong verbal and written communication skills
  • AWS Certification is a plus

Interested in this job?

Jobs Related To Nielsen Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Senior Data Engineer

Senior Data Engineer position at PepsiCo in Barcelona, focusing on financial data engineering and analytics using Azure cloud technologies.

Sr Data Engineer

Senior Data Engineer position at PepsiCo focusing on building and managing enterprise-scale data pipelines and infrastructure using Azure cloud services.

Data Engineer, Corporate Data

Senior Data Engineer position at DoorDash focusing on People Analytics infrastructure and data-driven insights for talent management in São Paulo, Brazil.

Senior Integrations Developer

Senior Integrations Developer role at Tonal, building data integration solutions for the world's first AI-powered home gym. Toronto-based, hybrid role with competitive compensation.

Senior Software Engineer

Senior Software Engineer position at Wells Fargo focusing on data engineering and platform development for consumer lending technology.