Principal / Staff Data Engineer- Big Data

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it's consumed. As a Principal Software Engineer, you will be a contributor on a Scrum/DevOps team focusing on analyzing, developing, testing, and supporting highly complex application software. You will work independently and possibly lead a team to analyze, develop, test, and support highly complex application software. Some systems will be in legacy technology and require the ability to interpret code and process flows. You will provide technical expertise and guidance to project team members and help develop strategies for developing complex applications. Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.

Key Responsibilities: • Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises. • Build and test software code in current technologies and legacy applications. • Build platform reusable code and components that could be used by multiple project teams. • Provide cloud integration development support to various project teams. • Rapidly identify and resolve technical incidents as they emerge. • Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines.

Required Skills and Experience: • 6-9 years of related experience with a Bachelor's degree or higher. • Experience in software development using programming languages & tools/services: Java, Python, and strong in SQL. • Frontend Technology Skills: JavaScript, Grails, SQL, and shell scripting experience. • Backend Technology Skills: AWS and/or Oracle Cloud experience, Java, ETL Tools (Informatica, Talend, ODI), Strong SQL knowledge, Python, Scripting. • Big Data Skills (3-5 years): Spark Scala, Spark SQL, AWS Cloud (EC2, S3). • Strong knowledge of Unix/Linux OS, commands, shell scripting, python. • Agile scrum experience in application development. • Strong knowledge in AWS S3, PostgreSQL or MySQL. • Strong knowledge in Gitlab/Bitbucket. • Strong knowledge in AWS Compute: EC2, EMR, AWS Lambda.

Desired Skills: • Airflow, Gitlab, Parquet File processing. • Deployment and automation: Terraform, Cloud Formation. • Legacy technology such as FoxPro, COBOL, Struts. • AWS Certification.

Mindset and Attributes: • Strong verbal/written communication and interpersonal skills. • Strong leadership qualities and the ability to inspire and motivate a team. • Strong ability to translate business requirements into technical solutions and guide the team in execution.