Senior Software Engineer - Scala, Spark, Airflow, Python

Nielsen powers media future by providing insights that drive client decisions, capturing audience engagement with content across all platforms.
Data
Senior Software Engineer
Hybrid
5+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Senior Software Engineer - Big Data

Senior Software Engineer position at Nielsen focusing on big data solutions and scalable web services for Mobile Meters, offering hybrid work in Mumbai.

Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Sr. Data Engineer at Nielsen: Build scalable Big Data solutions using Spark, AWS, and cloud technologies in Bangalore, India.

Senior Data Scientist, Research, Ads Metrics

Senior Data Scientist position at Google focusing on ads metrics research, offering competitive compensation and the opportunity to shape advertising products.

Senior Data Scientist, Research, Workspace

Senior Data Scientist position at Google focusing on Workspace products, requiring 5+ years of analytics experience and expertise in Python, R, and SQL.

Senior Data Scientist, Product, Google Store

Senior Data Scientist position at Google Store focusing on product analytics, requiring 5+ years of experience in data analysis, statistics, and programming.

Description For Senior Software Engineer - Scala, Spark, Airflow, Python

Nielsen, a leading company in media measurement and analytics, is seeking a Senior Software Engineer to join their DevOps team. This role focuses on developing and supporting big data applications, combining cutting-edge technologies with business impact.

The position offers an exciting opportunity to work with modern big data technologies including Scala, Spark, and Airflow, while leveraging AWS cloud infrastructure. As a senior engineer, you'll be responsible for designing, coding, and testing complex data applications that power Nielsen's media insights platform.

The ideal candidate will bring 5+ years of software development experience, with strong expertise in Java, Python, and SQL programming. You'll work in an Agile environment, collaborating with cross-functional teams to deliver high-quality solutions that drive client decisions and deliver extraordinary results.

Key aspects of the role include building reusable platform components, implementing CI/CD practices, and ensuring best practices in cloud architecture. You'll be part of a dynamic team that values technical excellence, continuous learning, and innovation. The position offers a hybrid work arrangement in Bengaluru, India, allowing for both collaborative in-person work and flexible remote options.

This role is perfect for someone who is passionate about big data, cloud technologies, and wants to make an impact in the media measurement industry. You'll have the opportunity to work with cutting-edge technologies while contributing to Nielsen's mission of powering a better media future for all people.

Last updated 3 months ago

Responsibilities For Senior Software Engineer - Scala, Spark, Airflow, Python

  • Design, code, and test complex big data applications deployed on AWS Cloud Infrastructure
  • Develop and maintain automated unit and functional test cases with CICD integration
  • Analyze and troubleshoot data-related problems
  • Support product owner in defining future stories and technical requirements
  • Build reusable platform code and components
  • Conduct peer code reviews and maintain continuous delivery practices
  • Collaborate with cross-functional teams and stakeholders

Requirements For Senior Software Engineer - Scala, Spark, Airflow, Python

Python
Java
Kafka
Redis
PostgreSQL
  • Bachelor's degree in computer science, engineering or relevant field
  • Strong cloud implementation expertise in AWS architecture
  • Knowledge of multi-zone, region-based designs
  • Advanced Java programming skills
  • Intermediate Python programming skills
  • Advanced SQL programming skills
  • Experience with Spark for big data processing
  • Experience with Apache Airflow
  • Strong knowledge of Unix/Linux OS and shell scripting
  • Experience with AWS services (EC2, EKS, S3, Lambda, RDS, SNS, Elasticache)
  • Knowledge of CI/CD processes and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube)
  • Agile scrum experience
  • AWS Certification (preferred)

Interested in this job?