Senior Data Engineer

Edelman is a trusted communications company reimagining the future where action is the currency of communication.
Data
Senior Software Engineer
Remote
5+ years of experience
AI · Enterprise SaaS

Description For Senior Data Engineer

Edelman, a trusted voice in communications, is seeking a Senior Data Engineer to join their innovative team. This role offers an exciting opportunity to work with cutting-edge technologies including Generative AI, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG) techniques. The position involves building intelligent, data-driven systems that deliver powerful PR insights and developing agentic workflows for autonomous task orchestration.

The ideal candidate will have 5-7 years of experience and the ability to work independently in an AGILE environment. You'll work with modern cloud infrastructure using tools like Apache Airflow, Databricks, DBT, and Snowflake. The role requires expertise in real-time data processing and AI implementation, particularly in generative AI applications.

At Edelman, we foster a collaborative and open environment where innovation is celebrated. Our data engineering team works with a modern and efficient data stack designed to process large-scale information, automate analysis pipelines, and integrate seamlessly with AI-driven workflows. This position offers the opportunity to make significant impacts on projects that push the boundaries of AI-powered insights and automation.

The company is committed to diversity, equity, inclusion, and belonging (DEIB), creating an equitable and inspiring workplace that reflects the world we live in. We value trust, collaboration, and belonging, making it an ideal environment for professionals who are passionate about building high-performance data systems and working with cutting-edge AI frameworks.

This role combines technical expertise with the opportunity to work on meaningful projects that shape the future of PR insights and automation. The position offers the perfect blend of technical challenges and professional growth in a supportive, forward-thinking environment.

Last updated 2 days ago

Responsibilities For Senior Data Engineer

  • Design, build, and maintain scalable and robust data pipelines
  • Design, maintain, and optimize data models in Snowflake and Databricks
  • Leverage Databricks and Cloud-native solutions for big data processing
  • Utilize PySpark and/or Ray to build and scale distributed computing tasks
  • Monitor, troubleshoot, and resolve issues within data pipelines
  • Integrate generative AI capabilities into data pipelines and workflows
  • Collaborate with machine learning engineers to optimize generative AI workflows
  • Develop APIs and tools for generative AI models consumption
  • Document data engineering workflows and generative AI integrations
  • Collaborate with cross-functional teams to implement new product features

Requirements For Senior Data Engineer

Python
  • Minimum of 5 years of experience in enterprise-level scalable data engineering solutions
  • Experience with independently developed data pipelines end-to-end
  • Experience with AWS (S3, Dynamo DB, EMR)
  • Experience implementing AI model lifecycles including generative AI
  • Familiarity with OpenAI API, Hugging Face Transformers
  • Experience with Apache Airflow, Snowflake, and Lucene-based search engines
  • Advanced SQL and Python knowledge
  • Experience with Databricks
  • Strong DevOps practices for CI/CD
  • Experience with structured & unstructured file formats
  • Data quality best practice implementation
  • Real-time data processing experience with Apache Kafka
  • Knowledge of generative AI model architectures
  • Strong collaboration and communication skills
  • Fluency in English

Interested in this job?

Jobs Related To Edelman Senior Data Engineer

Senior Business Intelligence Engineer, Sales Insights & Recommendations

Senior Business Intelligence Engineer role at Amazon Advertising, focusing on data analysis and BI solutions for sales team effectiveness.

Sr. Data Engineer, Customer Engagement Technology

Senior Data Engineer position at Amazon focusing on customer service technology, requiring 5+ years experience in data engineering, offering competitive salary and benefits.

Senior Business Intelligence Engineer, Supply Chain, Placement Analytics

Senior BI Engineer role at Amazon focusing on supply chain optimization and inventory placement analytics, requiring 10+ years experience with competitive compensation.

Business Intelligence Engineer, Infra-Finance Business Intelligence & Transformations

Senior Business Intelligence Engineer role at AWS, focusing on analytics platform development for Infrastructure Supply Chain Finance organization.

Clinical Data Engineer

Senior Clinical Data Engineer position at Apple's Biophotonics group, focusing on bio-sensing technologies and clinical data platform development.