Join Twilio as a Staff Data Engineer on the Messaging Data Platform team. You'll build and maintain highly scalable, reliable, and efficient data pipelines to empower both inbound and outbound messaging stacks with data insights interfaces for real-time decision-making.
Responsibilities include:
- Overseeing design, construction, testing, and maintenance of advanced, scalable data architectures and pipelines
- Driving development of innovative data solutions for complex business requirements
- Creating and enforcing best practices for data architecture
- Providing architectural guidance and mentorship to junior engineers
- Tackling challenging technical issues and providing advanced troubleshooting
- Collaborating with senior leadership on data engineering strategies
- Participating in long-term planning for data infrastructure and analytics
- Leading cross-functional projects
- Coordinating with stakeholders to define project requirements
- Continuously monitoring and enhancing data systems performance
Required qualifications:
- 3+ years of Java development experience
- 5+ years of experience with Big Data processing tools (Apache Spark, SparkSQL)
- Experience with Lakehouse technologies (Apache Hudi, Apache Iceberg, Databricks Delta Lake)
- Experience in building AI/ML pipelines
- Deep understanding of ETL tools, data stores, warehouses, and catalogs
- Familiarity with data testing and verification best practices
- Experience with cloud services (AWS preferred)
- Proficiency in Key-Value, Streaming, and Search Database technologies
- Readiness to participate in on-call rotation
Twilio offers competitive pay, generous time-off, parental and wellness leave, healthcare, retirement savings, and more. They value diversity, equity & inclusion and are committed to becoming a globally anti-racist, anti-oppressive, anti-bias company.