Senior Data Platform Engineer
Description For Senior Data Platform Engineer
Stack is at the forefront of developing revolutionary AI and advanced autonomous systems for the trucking transportation industry. Our technology integrates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies to create innovative solutions that enhance safety, reliability, and efficiency in modern operations.
As a member of the Data Platform team within the Platform Infrastructure Engineering and Reliability group, you'll play a crucial role in designing, implementing, and maintaining Stack's on-premises data platform. This platform supports large-scale OLAP/OLTP and feature engineering workloads for multiple Product Development groups across the company.
Your responsibilities will include:
- Designing and implementing a highly-available and scalable data infrastructure
- Engaging in requirements gathering and design processes
- Providing production-grade support to internal engineering teams
- Collaborating cross-functionally to meet customer use cases and deliver business value
- Automating routine tasks and creating proactive alert systems
- Contributing to open-source projects and working with outside vendors
- Implementing security best practices and troubleshooting performance issues
This role offers an exciting opportunity to work with cutting-edge technologies in the autonomous vehicle industry, contribute to open-source projects, and shape the future of transportation. Join our diverse and inclusive team, where innovation and entrepreneurship are valued, and make a significant impact in the field of autonomous systems.
Responsibilities For Senior Data Platform Engineer
- Design, implement, maintain, and operate the on-premises data platform for large-scale OLAP/OLTP and feature engineering workloads
- Engage in requirements gathering and participate in the design process
- Provide production-grade support to internal engineering teams
- Collaborate cross-functionally within the organization
- Automate routine administrative tasks and create alerts
- Identify and implement new features in OSS products
- Work with outside vendors
- Develop and implement security best practices
- Troubleshoot performance issues and identify/eliminate bottlenecks
Requirements For Senior Data Platform Engineer
- Computer Science degree (or equivalent experience)
- 7+ years of total experience with at least some running a service and providing support to users
- Expert level programming skills in 2+ languages like Python, Java, C++ or SQL
- Hands-on experience running Trino (or Presto)
- Familiarity with Object Storage and open table formats such as Iceberg, DeltaLake
- Experience with Apache Spark
- Hands-on experience with Terraform, Kubernetes and ArgoCD
- Strong communication skills
- Ability to provide and receive constructive feedback
- Willingness to participate in daily stand-ups
- Desire to learn new technologies and keep up to date with industry trends
Jobs Related To Stack Senior Data Platform Engineer
