Data Engineer II, ShipTech

Do you want to be in the forefront of engineering big data solutions that takes Transportation models to the next generation? We are looking for top notch Data Engineers to be part of our world class Transportation Business Intelligence team. We are building real time analytical platforms using big data tools and AWS technologies like Hadoop, Spark, EMR, SNS, SQS, Lambda, Kinesis Firehose, DynamoDB Streams.

The ideal candidate relishes working with large volumes of data, enjoys the challenge of highly complex technical contexts, and is passionate about data and analytics. You will be an expert with data modeling, ETL design, and business intelligence tools, partnering with the business to identify strategic opportunities where improvements in data infrastructure creates out-sized business impact.

Key Responsibilities:

• Perform quantitative analysis with large, complex data sources
• Work with Big data technologies and frameworks like Hive, Spark, Hadoop, SQL on Big Data, Redshift
• Develop near real-time analytics solutions
• Create ETL pipelines and optimize data models
• Write performant SQL queries for large data volumes
• Manage competing priorities and drive projects to completion

Requirements:

• 4-7 years of experience in data engineering
• Hands-on experience with Big data technologies
• Proficiency in scripting languages like Python or Perl
• Bachelor's degree or higher in a quantitative/technical field
• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda
• Knowledge of non-relational databases and data stores

Join our team to solve complex problems and create solutions that meet the growing worldwide need in transportation and logistics. It's a big ask, and we're excited to talk to those up to the challenge!