Senior Software Engineer, Data Platform
Description For Senior Software Engineer, Data Platform
At Stack, we are focused on AI advancements across diverse technical domains, transforming how AI is applied in the physical realm. Our solutions are designed to navigate and understand the world with unprecedented safety, reliability, and efficiency, transforming how modern industries operate. Our decades of expertise spans diverse AI applications reflecting our commitment to exploring new frontiers and delivering excellence in AI technology.
The Data Platform team is part of the Platform Infrastructure Engineering and Reliability group, and is responsible for designing, implementing and maintaining the Stack AV on-premises data platform. The team supports large scale OLAP/OLTP and feature engineering workloads for multiple Product Development groups across the company. The team is tasked with building a highly-available and scalable data infrastructure to power our critical services and pipelines. Members of the team are expected to have a strong focus on requirements gathering and design process to ensure our platform meets the needs of the business and our internal customers.
We are seeking passionate individuals to join our team, driven to develop and deploy advanced AI products that redefine industry standards, making processes safer, faster, and more efficient. If you thrive in fast-paced tech environments and are eager to contribute to transformative AI solutions, we invite you to join us in shaping the future of technology.
Key responsibilities and requirements include:
- Data Platform engineering focus, supporting large scale interactive and batch workloads
- Expert level understanding of Data Engineering concepts and open source technologies
- Experience running a modern data stack on-premises using open source technologies
- Fluency in Python and SQL, with experience in Trino and Apache Spark
- Strong focus on requirements gathering and overall design process
- Experience with workflow orchestration systems
- Focus on providing production-grade service through observability, instrumentation, and well-defined SLOs
- Experience working in diverse and distributed teams, with cross-functional collaboration
Join us in building the future of AI technology and transforming how modern industries operate!
Responsibilities For Senior Software Engineer, Data Platform
- Design, implement, and maintain the Stack AV on-premises data platform
- Support large scale OLAP/OLTP and feature engineering workloads
- Build highly-available and scalable data infrastructure
- Gather requirements and ensure the platform meets business needs
- Provide training on Data Engineering concepts to customers across the company
- Architect and optimize large-scale systems for machine learning, simulation, and data processing
- Work cross-functionally to meet customer use cases and deliver business value
Requirements For Senior Software Engineer, Data Platform
- Data Platform engineering focus, with experience supporting large scale interactive and batch workloads
- Expert level understanding of Data Engineering concepts and open source technologies
- Experience running a modern data stack on-premises using open source technologies
- Fluent in Python, and SQL, with experience writing and maintaining highly available data applications using Trino and Apache Spark
- Strong focus on requirements gathering and overall design process
- Experience running and supporting workflow orchestration systems
- Strong focus on providing production-grade service through observability, instrumentation, and well-defined SLOs
- Experience working in a diverse and distributed team, with a focus on communication and customer empathy
Jobs Related To Stack Senior Software Engineer, Data Platform
