Senior Software Engineer - Scala, Spark, Airflow, Python

Nielsen powers media future by providing insights that drive client decisions, capturing audience engagement with content across all platforms.
Data
Senior Software Engineer
Hybrid
5+ years of experience
Enterprise SaaS

Description For Senior Software Engineer - Scala, Spark, Airflow, Python

Nielsen, a leading company in media measurement and analytics, is seeking a Senior Software Engineer to join their DevOps team. This role focuses on developing and supporting big data applications, combining cutting-edge technologies with business impact.

The position offers an exciting opportunity to work with modern big data technologies including Scala, Spark, and Airflow, while leveraging AWS cloud infrastructure. As a senior engineer, you'll be responsible for designing, coding, and testing complex data applications that power Nielsen's media insights platform.

The ideal candidate will bring 5+ years of software development experience, with strong expertise in Java, Python, and SQL programming. You'll work in an Agile environment, collaborating with cross-functional teams to deliver high-quality solutions that drive client decisions and deliver extraordinary results.

Key aspects of the role include building reusable platform components, implementing CI/CD practices, and ensuring best practices in cloud architecture. You'll be part of a dynamic team that values technical excellence, continuous learning, and innovation. The position offers a hybrid work arrangement in Bengaluru, India, allowing for both collaborative in-person work and flexible remote options.

This role is perfect for someone who is passionate about big data, cloud technologies, and wants to make an impact in the media measurement industry. You'll have the opportunity to work with cutting-edge technologies while contributing to Nielsen's mission of powering a better media future for all people.

Last updated 14 days ago

Responsibilities For Senior Software Engineer - Scala, Spark, Airflow, Python

  • Design, code, and test complex big data applications deployed on AWS Cloud Infrastructure
  • Develop and maintain automated unit and functional test cases with CICD integration
  • Analyze and troubleshoot data-related problems
  • Support product owner in defining future stories and technical requirements
  • Build reusable platform code and components
  • Conduct peer code reviews and maintain continuous delivery practices
  • Collaborate with cross-functional teams and stakeholders

Requirements For Senior Software Engineer - Scala, Spark, Airflow, Python

Python
Java
Kafka
Redis
PostgreSQL
  • Bachelor's degree in computer science, engineering or relevant field
  • Strong cloud implementation expertise in AWS architecture
  • Knowledge of multi-zone, region-based designs
  • Advanced Java programming skills
  • Intermediate Python programming skills
  • Advanced SQL programming skills
  • Experience with Spark for big data processing
  • Experience with Apache Airflow
  • Strong knowledge of Unix/Linux OS and shell scripting
  • Experience with AWS services (EC2, EKS, S3, Lambda, RDS, SNS, Elasticache)
  • Knowledge of CI/CD processes and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube)
  • Agile scrum experience
  • AWS Certification (preferred)

Interested in this job?

Jobs Related To Nielsen Senior Software Engineer - Scala, Spark, Airflow, Python

Senior Software Engineer - Big Data

Senior Software Engineer position at Nielsen focusing on big data solutions and scalable web services for Mobile Meters, offering hybrid work in Mumbai.

Senior Software Engineer - Scala, Spark, Airflow, Python

Senior Software Engineer position at Nielsen focusing on big data applications using Scala, Spark, Airflow, and Python in a hybrid work environment.

Senior Software Engineer - Scala, Spark, Airflow, Python

Senior Software Engineer position at Nielsen focusing on big data applications using Scala, Spark, Airflow, and Python with AWS cloud infrastructure.

Senior Software Engineer (Arch)

Senior Software Engineer position at Nielsen, focusing on data engineering and identity graph development using Scala, Python, and AWS technologies.

Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Sr. Data Engineer at Nielsen: Build scalable Big Data solutions using Spark, AWS, and cloud technologies in Bangalore, India.