Principal Data Engineer
Description For Principal Data Engineer
Nielsen Global Media, a leading consumer analytics company, is seeking a Principal Data Engineer to join their innovative team. This role combines advanced analytics programming with large-scale data processing, offering an opportunity to work with billions of data points across more than 100 countries.
The position requires expertise in modern analytics programming, focusing on developing and orchestrating econometric and machine learning modules. You'll be working with cutting-edge technologies including Python, Spark, and SQL, creating sophisticated data processing systems for analytics research and development.
As a Principal Data Engineer, you'll be instrumental in designing and implementing cloud-based analytical solutions, working closely with the Software Engineering department. The role offers the flexibility of remote work from anywhere in the U.S., with minimal travel requirements (1-5 days annually).
The ideal candidate will bring a strong educational background in Computer Science, Data Science, or a related quantitative field, coupled with extensive experience in analytics software solutions. You'll need proven expertise in Python, AWS, SQL, and various cloud technologies, along with experience in managing large-scale data processing systems.
This role offers competitive compensation ranging from $142,771 to $225,000 annually, reflecting the senior nature of the position. You'll be part of a diverse, inclusive workplace that values equal opportunity and innovation. The position provides an excellent opportunity to work with global data sets and contribute to solutions that help businesses understand consumer behavior and market trends.
Working at Nielsen means being at the forefront of consumer analytics, with access to vast amounts of data and the opportunity to develop solutions that directly impact global business decisions. You'll be part of a team that's constantly evolving and pushing the boundaries of data science and analytics.
The role combines technical expertise with business impact, requiring both strong programming skills and the ability to understand the broader business context of analytical solutions. You'll work in an agile environment, collaborating with cross-functional teams to deliver sophisticated analytical solutions.
Responsibilities For Principal Data Engineer
- Develop, test and orchestrate econometric, statistical and machine learning modules
- Perform unit, integration and regression testing
- Create data processing systems for analytic research and development
- Design, write, and test modules for Nielsen analytics cloud-based platforms
- Extract data from platforms using SQL
- Orchestrate modules via directed acyclic graphs
- Design, document, and present process flows for analytical systems
- Partner with Software Engineering department to build cloud-based analytical solutions
- Work in an agile development environment
Requirements For Principal Data Engineer
- Master's degree in Computer Science, Data Science, engineering, mathematics, or another quantitative field plus 3 years of experience (or Bachelor's plus 5 years)
- 3 years experience with Python and associated packages including Spark, AWS, S3
- 3 years experience with Java, JavaScript, and Adobe Analytics
- 3 years experience using SQL for querying, extracting, and managing data
- Experience with parallel processing handling very large volumes of data
- Experience with code management tools such as Git
- 2 years experience managing computer program orchestrations
- 2 years experience using open-source management platforms such as AirFlow
- 2 years experience working as a team member
- Willing to travel domestically and internationally 1-5 days per year
