Senior Big Data Engineer

DoubleVerify is an Israeli-founded big data analytics company (Stock: NYSE: DV) that tracks and analyzes tens of billions of ads every day for the biggest brands in the world.
Data
Senior Software Engineer
Contact Company
1,000 - 5,000 Employees
4+ years of experience
AI · Finance · Enterprise SaaS

Description For Senior Big Data Engineer

DoubleVerify is an Israeli-founded big data analytics company (Stock: NYSE: DV) that tracks and analyzes tens of billions of ads every day for the biggest brands in the world. We operate at a massive scale, handling over 100B events per day and over 1M RPS at peak, processing events in real-time at low latencies (ms) and analyzing over 2.5M video years every day.

As a Senior Big Data Engineer, you will:

  • Work in a team of data and software engineers building our Authentic Attention products
  • Process 10's of billions of records a day using mainly Python and Scala
  • Utilize advanced technologies like Spark, Kafka, Docker, Kubernetes, DataBricks, and GCP managed solutions
  • Build the next generation of digital advertising optimization tools
  • Maintain high engineering standards including testing, automated deployment, infrastructure as code, and high degree of monitoring and availability

Requirements:

  • At least 4 years in Software Development
  • At least 3 years experience coding in Python/Java/C#/Scala
  • At least 3 years experience working with relational databases
  • At least 2 years of experience building ETLs or ELTs
  • Good analytical skills and well versed with SQL
  • Good interpersonal and communication skills
  • Passion for development with high quality and a sharp mind
  • Experience maintaining business-critical production systems

Nice to have:

  • Experience with Python
  • Experience with CI/CD pipeline, Docker & Kubernetes, public cloud providers
  • Experience with Spark
  • Experience with non-relational DB
  • Experience with streaming processing
  • Experience with online advertising technologies

Join DoubleVerify to work on high-impact projects in a fast-paced environment, solving challenges at a massive scale in the digital advertising industry.

Last updated 6 months ago

Responsibilities For Senior Big Data Engineer

  • Work in a team of data and software engineers building our Authentic Attention products
  • Process 10's of billions of records a day using mainly Python and Scala
  • Utilize advanced technologies like Spark, Kafka, Docker, Kubernetes, DataBricks, and GCP managed solutions
  • Build the next generation of digital advertising optimization tools
  • Maintain high engineering standards including testing, automated deployment, infrastructure as code, and high degree of monitoring and availability

Requirements For Senior Big Data Engineer

Python
Java
Scala
Kafka
Kubernetes
  • At least 4 years in Software Development
  • At least 3 years experience coding in Python/Java/C#/Scala
  • At least 3 years experience working with relational databases
  • At least 2 years of experience building ETLs or ELTs
  • Good analytical skills and well versed with SQL
  • Good interpersonal and communication skills
  • Passion for development with high quality and a sharp mind
  • Experience maintaining business-critical production systems

Interested in this job?

Jobs Related To DoubleVerify Senior Big Data Engineer

Senior Data Engineer

Senior Data Engineer role at DoubleVerify's Scibids AI division in Paris, focusing on ETL, data pipeline development, and AI-driven campaign optimization.

Sr Lead Software Engineer- Oracle, SQL, Data Modeling

Senior Lead Software Engineer role at JPMorgan Chase focusing on Oracle, SQL, and Data Modeling, requiring 5+ years of experience in database design and optimization.

Sr. Business Intelligence Engineer

Senior Business Intelligence Engineer role at Amazon Search, focusing on reinforcement learning systems and data analysis to optimize shopping experiences for millions of customers.

Sr. Business Intelligence Engineer, Long Term Planning

Senior Business Intelligence Engineer role at Amazon focusing on supply chain optimization and transportation planning across Europe, based in Luxembourg.

Business Intelligence Engineer (L5), Amazon

Senior Business Intelligence Engineer role at Amazon Payment team, focusing on data analytics and insights for Japan Payment Products.