We are seeking a dynamic Full Stack Data Engineer to join our team. The ideal candidate will possess a comprehensive skill set across the entire data engineering lifecycle, including data storage, processing, integration, and application development. This role demands a deep understanding of various databases, data warehouses, and big data technologies such as Hadoop and Spark, proficient in SQL and Python as well as ETL processes and development strategies.
Responsibilities:
- Design and implement scalable data storage and processing solutions.
- Integrate data from diverse sources like APIs, streaming platforms, and batch data into cohesive pipelines.
- Develop and maintain ETL processes, ensuring data accuracy and efficiency.
- Deploy and manage data pipelines, databases, and applications, focusing on high-quality deliverables.
- Work independently and contribute significantly to the company's data engineering initiatives.
Requirements:
- 3-5+ years of experience in modern database technology, data modeling, building data products, distributed data systems, and test data engineering
- Proficiency in SQL, Python, and Spark.
- Extensive experience with AWS (S3, EC2, EMR, Redshift, Athena, Clue, Lambda)
- Proven track record in building real-time and batch data pipelines using tools such as Airflow, Spark, Kafka, Fivetran, Census, DBT, etc.
- Expertise in data platform infrastructure management, including Data Warehouses and Data Lakes (Redshift, Big Query, Snowflake, Delta Lake, etc.).
- Minimum 5 years of development experience in Python, Java, Scala, or Node.
Bonus Skills:
- Experience with serverless architecture or Infrastructure as Code (e.g. Terraform, Serverless Framework, AWS CloudFormation).
- Familiarity with Pandas, Dusk, Ray, Node.
- Proven ability to maintain and evolve code to meet user demands.
- AWS Solution Architect - Professional or AWS Certified Data Analytics - Specialty certification is a plus.
- Over 5 years of experience in data governance, data access, data lineage, monitoring, and security controls.
This is a hybrid position with a requirement of 3 days in our Omaha, Nebraska office. Join Unison, a San Francisco-based company that is expanding rapidly and has been recognized by the Deloitte Technology Fast500 awards and Forbes Fintech50. We offer competitive salaries, 100% paid medical and dental benefits, generous PTO policy, paid parental leave program, and a fantastic downtown SF location.