Senior Big Data Engineer

DoubleVerify is an Israeli-founded big data analytics company (Stock: NYSE: DV) that tracks and analyzes tens of billions of ads every day for the biggest brands in the world.
Data
Senior Software Engineer
Contact Company
1,000 - 5,000 Employees
4+ years of experience
AI · Finance · Enterprise SaaS

Description For Senior Big Data Engineer

DoubleVerify is an Israeli-founded big data analytics company (Stock: NYSE: DV) that tracks and analyzes tens of billions of ads every day for the biggest brands in the world. We operate at a massive scale, handling over 100B events per day and over 1M RPS at peak, processing events in real-time at low latencies (ms) and analyzing over 2.5M video years every day.

As a Senior Big Data Engineer, you will:

  • Work in a team of data and software engineers building our Authentic Attention products
  • Process 10's of billions of records a day using mainly Python and Scala
  • Utilize advanced technologies like Spark, Kafka, Docker, Kubernetes, DataBricks, and GCP managed solutions
  • Build the next generation of digital advertising optimization tools
  • Maintain high engineering standards including testing, automated deployment, infrastructure as code, and high degree of monitoring and availability

Requirements:

  • At least 4 years in Software Development
  • At least 3 years experience coding in Python/Java/C#/Scala
  • At least 3 years experience working with relational databases
  • At least 2 years of experience building ETLs or ELTs
  • Good analytical skills and well versed with SQL
  • Good interpersonal and communication skills
  • Passion for development with high quality and a sharp mind
  • Experience maintaining business-critical production systems

Nice to have:

  • Experience with Python
  • Experience with CI/CD pipeline, Docker & Kubernetes, public cloud providers
  • Experience with Spark
  • Experience with non-relational DB
  • Experience with streaming processing
  • Experience with online advertising technologies

Join DoubleVerify to work on high-impact projects in a fast-paced environment, solving challenges at a massive scale in the digital advertising industry.

Last updated 4 months ago

Responsibilities For Senior Big Data Engineer

  • Work in a team of data and software engineers building our Authentic Attention products
  • Process 10's of billions of records a day using mainly Python and Scala
  • Utilize advanced technologies like Spark, Kafka, Docker, Kubernetes, DataBricks, and GCP managed solutions
  • Build the next generation of digital advertising optimization tools
  • Maintain high engineering standards including testing, automated deployment, infrastructure as code, and high degree of monitoring and availability

Requirements For Senior Big Data Engineer

Python
Java
Scala
Kafka
Kubernetes
  • At least 4 years in Software Development
  • At least 3 years experience coding in Python/Java/C#/Scala
  • At least 3 years experience working with relational databases
  • At least 2 years of experience building ETLs or ELTs
  • Good analytical skills and well versed with SQL
  • Good interpersonal and communication skills
  • Passion for development with high quality and a sharp mind
  • Experience maintaining business-critical production systems

Interested in this job?

Jobs Related To DoubleVerify Senior Big Data Engineer

Sr. Software Engineer II (Data)

Senior Software Engineer II (Data) role at DoubleVerify, focusing on programmatic and platform products, requiring Python, SQL, and distributed systems expertise.

Senior Data Engineer

Senior Data Engineer role at DoubleVerify's Scibids AI division in Paris, focusing on ETL, data pipeline development, and AI-driven campaign optimization.

Data Engineer

Senior Data Engineer position at Calm, building scalable data solutions using AWS/GCP stack to support mental health app serving 150M+ users globally.

Data Engineer

Senior Data Engineer role at Kalshi, building and maintaining data infrastructure for the first legal prediction markets platform in the US.

Senior Data Engineer

Senior Data Engineer position at Ebury, working on data warehouse and ETL pipelines using modern cloud technologies in Madrid