Distributed Systems Data Engineer, Machine Learning (Slack Search)

Slack is a technology company revolutionizing workplace communication and information discovery through advanced search and collaboration tools.
Data
Senior Software Engineer
In-Person
5+ years of experience
AI · Enterprise SaaS

Description For Distributed Systems Data Engineer, Machine Learning (Slack Search)

Slack is seeking a Search Infrastructure Data Engineer to join their Core Infrastructure organization, focusing on revolutionizing information discovery and search technologies. This role is crucial in building cutting-edge search technologies that deliver relevant and personalized results to users.

The position sits at the intersection of Search Infrastructure and Machine Learning Infrastructure, where you'll be responsible for designing, building, and maintaining data infrastructure and pipelines that power search and recommendation systems. The Core Infrastructure team is fundamental to Slack's functionality, managing the information retrieval infrastructure that supports Search, ML, and various product experiences.

As a Search Infrastructure Data Engineer, you'll work with cutting-edge technologies including Elasticsearch, Kubernetes, and various big data tools. You'll collaborate closely with data scientists and ML engineers to deploy machine learning models for semantic retrieval, while also maintaining and optimizing data pipelines for production environments.

The ideal candidate brings 5+ years of relevant experience in data engineering with a focus on search, along with expertise in programming languages like Python, Java, or Scala. Knowledge of big data technologies, cloud platforms, and strong problem-solving skills are essential. The role offers opportunities to work on innovative search technologies while contributing to a positive, diverse, and supportive culture where curiosity and collaboration are valued.

This position offers competitive compensation, professional growth opportunities, and the chance to work with a collaborative team that values smart, humble, and hardworking individuals. Join Slack to help build the future of workplace information discovery and search technology.

Last updated 2 months ago

Responsibilities For Distributed Systems Data Engineer, Machine Learning (Slack Search)

  • Design and develop scalable and resilient information retrieval infrastructure
  • Build and integrate scalable backend systems and data warehouse tools
  • Develop and maintain ETL processes
  • Collaborate with data scientists to deploy machine learning models
  • Optimize data storage and retrieval for real-time search
  • Monitor and troubleshoot data pipelines in production
  • Maintain and improve various data pipelines
  • Mentor other engineers and review code
  • Improve engineering standards, tooling, and processes

Requirements For Distributed Systems Data Engineer, Machine Learning (Slack Search)

Python
Java
Scala
Kubernetes
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field
  • 5+ years of relevant technical experience in data engineering with focus on search
  • Experience with search technologies (Elasticsearch, Solr, or Lucene)
  • Proficiency in Python, Java, or Scala
  • Experience with big data technologies (Airflow, EMR, Hadoop, Hive, Spark, Kafka)
  • Solid understanding of SQL and NoSQL databases
  • Experience with cloud platforms and containerization
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills

Benefits For Distributed Systems Data Engineer, Machine Learning (Slack Search)

  • Competitive salary and benefits package
  • Professional development and growth opportunities
  • Collaborative and inclusive work environment

Interested in this job?

Jobs Related To Slack Distributed Systems Data Engineer, Machine Learning (Slack Search)

Sr.Software Engineer (Java&Data)

Senior Software Engineer position at PointClickCare focusing on Java and Data engineering, offering competitive salary and comprehensive benefits package.

Senior Data Engineer

Senior Data Engineer position at Homebase, building and maintaining data pipelines and models using Databricks, Python, and SQL in a hybrid work environment in Toronto.

Senior Data Analytics Engineer

Senior Data Analytics Engineer role at FloSports, leading data infrastructure and analytics initiatives for sports streaming platform

Senior Data Engineer

Senior Data Engineer position at StackBlitz, building and maintaining data infrastructure for web development platform serving 1M+ developers monthly.

Business Intelligence Engineer, Japan Consumer Innovation (JCI), Data Services & Technologies

Senior Business Intelligence Engineer role at Amazon Japan, focusing on data architecture and analytics for the Vendor Success Program Plus initiative.