Data Engineer, Network Product Development - Optics

Amazon seeks an experienced Data Engineer to join the NPD (Network Product Development) interconnects metrics team. Our mission is to provide the data, metrics, alarming, and monitoring needed to improve the health of the network and increase availability to our customers as part of a Continuous Improvement Model for Interconnects within AWS Data Centers. As a member of The Amazon Network Infrastructure team, you'll have a unique opportunity to shape the development of one of the world's largest and most complex optical networks.

Key responsibilities include:

• Develop and collect metrics to track and monitor the performance of the Amazon network
• Design, implement, and support data warehouse/data lake infrastructure using AWS big data stack
• Create and support real-time data pipelines built on AWS technologies
• Develop dashboards using business intelligence and visualization software
• Collaborate with other teams to implement advanced analytics algorithms
• Explore new datasets and establish mechanisms to provide access to them
• Empower customers to drive their own analytics and reporting
• Work with network operations team to identify operational issues

You'll work with cutting-edge AWS big data technologies and have the opportunity to influence the broad industry while developing software tools to maintain a highly available network. The role requires excellent business and communication skills to work with business owners and tech leaders.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, Physics, or equivalent
• 4+ years of hands-on experience with onboarding to and collecting data
• 3+ years of experience with developing metrics from data
• 2+ years of experience creating software to ingest and load data through pipelines
• 2+ years of experience validating and cleaning data
• Experience with big data technologies such as Hadoop, Hive, Spark, EMR

Preferred qualifications include experience with AWS technologies, distributed systems, databases and SQL, and the software development lifecycle. The ideal candidate will meet or exceed Amazon's leadership principles and functional/technical depth requirements for this role.

Amazon offers a competitive compensation package, including equity, sign-on payments, and a full range of medical, financial, and other benefits. The base pay for this position ranges from $118,900/year to $205,600/year, depending on factors such as location and experience.