Lead Software Engineer- Data Orchestration

Enterprise software company providing cloud-based CRM and collaboration tools, including Slack.
$184,000 - $253,000
Data
Staff Software Engineer
In-Person
5+ years of experience
Enterprise SaaS

Description For Lead Software Engineer- Data Orchestration

Join Slack's Data Orchestration Team as a Senior Software Engineer within the Data Engineering organization. We're building and operating the platform that ingests data into our Data Warehouse and maintaining low-latency, high-throughput analytics with OLAP DB. Our infrastructure handles 65PB+ of storage, processes ~900B records daily, manages 400+ ETL pipelines, and 1300+ Active Airflow DAGs.

As a Lead Software Engineer, you'll be instrumental in building scalable services and tools to help partners implement, deploy, and analyze data assets efficiently. The role requires deep technical skills and a passion for driving data-driven decisions. You'll work on developing real-time analytics solutions, optimizing data workflows, and improving pipeline reliability.

The position offers an opportunity to work with cutting-edge technologies including modern OLAP solutions, cloud infrastructure (AWS), and distributed microservices. You'll be part of a team that values technical excellence, mentorship, and cross-functional collaboration. The role combines hands-on technical work with leadership responsibilities, making it perfect for engineers who want to make a significant impact while growing their careers.

Working at Slack means joining a company that's revolutionizing business communication, with a data infrastructure that processes billions of records daily. You'll be at the forefront of solving complex data engineering challenges while working with a talented team in a collaborative environment. The role offers competitive compensation and the chance to work on technology that impacts millions of users worldwide.

Last updated 4 days ago

Responsibilities For Lead Software Engineer- Data Orchestration

  • Develop and maintain real time analytics/low latency data access layer built on top of modern OLAP solutions
  • Optimize end-to-end workflow for data users at Slack
  • Improve data quality and reliability of pipelines through monitoring and failure detection
  • Collaborate with cross functional partners and lead technical initiatives
  • Coach and mentor other engineers across the org
  • Write and review technical design proposals

Requirements For Lead Software Engineer- Data Orchestration

Python
Java
Scala
Kubernetes
  • 5+ years of experience in data engineering or data infrastructure
  • Experience in real time analytics with OLAP stores like Apache Pinot or Apache Druid
  • Experience operating Airflow or other orchestration tools
  • Experience working with cloud infrastructure (AWS preferred)
  • Experience building and maintaining large scale ETL pipelines
  • Skilled at crafting robust distributed microservices with Docker, Kubernetes, AWS ECS/EKS
  • Strong dedication to code quality, automation and operational excellence
  • Proficient in Python, Java/Scala, Chef, Terraform
  • Excellent written and verbal communication skills
  • High growth expectations and willingness to push yourself and your team

Interested in this job?

Jobs Related To Salesforce (Slack) Lead Software Engineer- Data Orchestration

Senior Manager, Agentforce Success Analytics & Insights

Senior Analytics & Insights role at Salesforce leading strategic data initiatives and mentoring teams to drive customer success in the Agentforce product line.

Technical Architect, Data Cloud

Technical Architect position at Salesforce focusing on Data Cloud solutions, requiring expertise in cloud architecture, data systems, and enterprise solutions.

Lead Data Engineer

Lead Data Engineer position at Disney Entertainment & ESPN Technology, building scalable data solutions for streaming platforms.

Program Manager 5-ProdDev

Senior Principal Program Manager position at Oracle focusing on service management technologies and analytics capabilities.

Senior Staff Technical Program Manager, Data Storage

Senior Technical Program Manager role at Airbnb focusing on data infrastructure and storage systems, requiring 13+ years of experience and offering remote work options.