Staff, Data Engineer - Messaging Data Platform

Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.
Estonia
Data
Staff Software Engineer
Remote
1,000 - 5,000 Employees
5+ years of experience
Enterprise SaaS

Description For Staff, Data Engineer - Messaging Data Platform

Join Twilio as a Staff Data Engineer on the Messaging Data Platform team. You'll build and maintain highly scalable, reliable, and efficient data pipelines to empower both inbound and outbound messaging stacks with data insights interfaces for real-time decision-making.

Responsibilities include:

  • Overseeing design, construction, testing, and maintenance of advanced, scalable data architectures and pipelines
  • Driving development of innovative data solutions for complex business requirements
  • Creating and enforcing best practices for data architecture
  • Providing architectural guidance and mentorship to junior engineers
  • Tackling challenging technical issues and providing advanced troubleshooting
  • Collaborating with senior leadership on data engineering strategies
  • Participating in long-term planning for data infrastructure and analytics
  • Leading cross-functional projects
  • Coordinating with stakeholders to define project requirements
  • Continuously monitoring and enhancing data systems performance

Required qualifications:

  • 3+ years of Java development experience
  • 5+ years of experience with Big Data processing tools (Apache Spark, SparkSQL)
  • Experience with Lakehouse technologies (Apache Hudi, Apache Iceberg, Databricks Delta Lake)
  • Experience in building AI/ML pipelines
  • Deep understanding of ETL tools, data stores, warehouses, and catalogs
  • Familiarity with data testing and verification best practices
  • Experience with cloud services (AWS preferred)
  • Proficiency in Key-Value, Streaming, and Search Database technologies
  • Readiness to participate in on-call rotation

Twilio offers competitive pay, generous time-off, parental and wellness leave, healthcare, retirement savings, and more. They value diversity, equity & inclusion and are committed to becoming a globally anti-racist, anti-oppressive, anti-bias company.

Last updated 4 months ago

Responsibilities For Staff, Data Engineer - Messaging Data Platform

  • Oversee the design, construction, testing, and maintenance of advanced, scalable data architectures and pipelines
  • Drive the development of innovative data solutions that meet complex business requirements
  • Create and enforce best practices for data architecture, ensuring scalability, reliability, and performance
  • Provide architectural guidance and mentorship to junior engineers
  • Tackle the most challenging technical issues and provide advanced troubleshooting support
  • Collaborate with senior leadership to align data engineering strategies with organizational goals
  • Participate in long-term planning for data infrastructure and analytics initiatives
  • Lead cross-functional projects, ensuring timely delivery and alignment with business objectives
  • Coordinate with product managers, analysts, and other stakeholders to define project requirements and scope
  • Continuously monitor and enhance the performance of data systems and pipelines

Requirements For Staff, Data Engineer - Messaging Data Platform

Java
Kafka
  • 3+ years of Java development experience
  • 5+ years of experience with Big Data processing tools and frameworks such as Apache Spark, SparkSQL
  • Experience with Lakehouse technologies, such as Apache Hudi, Apache Iceberg, Databricks Delta Lake
  • Experience in building AI/ML pipelines
  • Deep technical understanding of ETL tools, low-latency data stores, multiple data warehouses and data catalogs
  • Familiarity with data testing and verification tooling and best practices
  • Experience with cloud services (AWS preferred, Google, Azure etc.)
  • Proficient in working with Key-Value, Streaming, and Search Database technologies, including AWS DynamoDB, Apache Kafka, and ElasticSearch
  • Readiness to participate in the on-call rotation

Benefits For Staff, Data Engineer - Messaging Data Platform

Medical Insurance
Parental Leave
401k
  • Competitive pay
  • Generous time-off
  • Parental and wellness leave
  • Healthcare
  • Retirement savings program

Interested in this job?

Jobs Related To Twilio Staff, Data Engineer - Messaging Data Platform

Data Science Manager - Engineering

Lead Netflix's data science engineering team, optimizing streaming infrastructure through analytics, experimentation, and machine learning, while managing senior technical talent.

Data Scientist (L5) - Ads (Measurement)

Lead Data Scientist role at Netflix focusing on ads measurement, requiring expertise in statistics, ML, and leadership skills, offering competitive compensation and comprehensive benefits.

Data Scientist (L5) - Ads (Experimentation)

Lead Data Scientist role at Netflix focusing on ads experimentation and analytics, offering remote work and competitive compensation.

Data Engineer 5 - Distributed Systems, Growth

Senior Data Engineer position at Netflix focusing on distributed systems and growth, building data products for customer experience optimization.

Staff Software Engineer, Data

Lead data engineering role building clinical trial matching platform, focusing on data architecture, modeling, and team leadership.