Data Engineer

Edelman is a voice synonymous with trust, reimagining communication through action, focusing on diversity, equity, inclusion and belonging.
Data
Mid-Level Software Engineer
Remote
3+ years of experience
AI · Enterprise SaaS

Description For Data Engineer

Edelman, a trusted name in communication, is seeking a Data Engineer with 3-5 years of experience to join their innovative team. This role offers an exciting opportunity to work with cutting-edge technologies in an AGILE environment, focusing on cloud infrastructure and tools like Apache Airflow, Databricks, and Snowflake.

The position involves designing and implementing modern data pipelines, optimizing workflows, and enabling seamless data integration across platforms. You'll work with state-of-the-art tools for data ingestion, transformation, storage, and analysis, ensuring high data quality and reliability.

The tech stack includes ETL/ELT pipelines, distributed computing frameworks, data lakes, and data warehouses. The team is actively exploring Generative AI techniques for data enrichment and automated reporting. You'll have the chance to work on both batch processing and streaming data pipelines, with opportunities to collaborate on AI-driven solutions.

Edelman values diversity, equity, inclusion, and belonging, creating an environment where every team member's voice matters. The company offers a collaborative atmosphere where data engineers can thrive while building robust, scalable systems that power insightful decision-making.

The ideal candidate should have strong experience with AWS, Python, SQL, and various data processing tools. They should be capable of working independently while collaborating effectively with cross-functional teams. This role presents an excellent opportunity for someone passionate about data engineering who wants to make a significant impact in a forward-thinking environment.

Last updated 2 days ago

Responsibilities For Data Engineer

  • Design, build, and maintain scalable and robust data pipelines for analytics and machine learning models
  • Design, maintain, optimize data models and data structures in Snowflake and Databricks
  • Leverage Databricks and Cloud-native solutions for big data processing
  • Utilize PySpark and/or Ray to build and scale distributed computing tasks
  • Monitor, troubleshoot, and resolve issues within data pipelines and infrastructure
  • Diagrammatically document data engineering workflows
  • Collaborate with Data Engineers, Product Owners, Software Developers and Machine Learning Engineers

Requirements For Data Engineer

Python
Kafka
  • Minimum of 3 years experience deploying enterprise level scalable data engineering solutions
  • Experience building and managing scalable cloud-based infrastructure on AWS
  • Experience with Apache Airflow, Snowflake, Lucene-based search engines
  • Experience with Databricks (Delta format, Unity Catalog)
  • Advanced SQL and Python knowledge
  • Strong Experience with DevOps practices for CI/CD
  • Experience with structured & unstructured file formats (Parquet, CSV, JSON)
  • Data Quality best practice implementation using Great Expectations
  • Real-time data processing experience using Apache Kafka
  • Excellent communication skills
  • Fluency in spoken and written English

Interested in this job?

Jobs Related To Edelman Data Engineer

Data Engineer

Data Engineer role at Amazon working on large-scale data solutions for the Payments team, handling billions of transactions and petabytes of data.

Software Development Engineer, Business Data Technologies

Senior Software Engineer role at Amazon building enterprise-wide Data Lake and next-gen data processing systems using AWS technologies.

Data Engineer, Amazon Shipping

Data Engineer position at Amazon Shipping focusing on developing data pipelines and infrastructure for global logistics network optimization.

Robotics Business Intelligence Engineer

Business Intelligence Engineer role at Amazon Robotics, focusing on data analytics and insights for robotic warehouse automation systems.

Data Engineer II, Shopbop

Data Engineer position at Shopbop (Amazon Fashion) building and optimizing data pipelines using AWS technologies