Distributed Systems Data Engineer, Machine Learning (Slack Search)

Slack is a technology company revolutionizing workplace communication and information discovery through advanced search and collaboration tools.
Data
Senior Software Engineer
In-Person
5+ years of experience
AI · Enterprise SaaS

Description For Distributed Systems Data Engineer, Machine Learning (Slack Search)

Slack is seeking a Search Infrastructure Data Engineer to join their Core Infrastructure organization, focusing on revolutionizing information discovery and search technologies. This role is crucial in building cutting-edge search technologies that deliver relevant and personalized results to users.

The position sits at the intersection of Search Infrastructure and Machine Learning Infrastructure, where you'll be responsible for designing, building, and maintaining data infrastructure and pipelines that power search and recommendation systems. The Core Infrastructure team is fundamental to Slack's functionality, managing the information retrieval infrastructure that supports Search, ML, and various product experiences.

As a Search Infrastructure Data Engineer, you'll work with cutting-edge technologies including Elasticsearch, Kubernetes, and various big data tools. You'll collaborate closely with data scientists and ML engineers to deploy machine learning models for semantic retrieval, while also maintaining and optimizing data pipelines for production environments.

The ideal candidate brings 5+ years of relevant experience in data engineering with a focus on search, along with expertise in programming languages like Python, Java, or Scala. Knowledge of big data technologies, cloud platforms, and strong problem-solving skills are essential. The role offers opportunities to work on innovative search technologies while contributing to a positive, diverse, and supportive culture where curiosity and collaboration are valued.

This position offers competitive compensation, professional growth opportunities, and the chance to work with a collaborative team that values smart, humble, and hardworking individuals. Join Slack to help build the future of workplace information discovery and search technology.

Last updated 3 months ago

Responsibilities For Distributed Systems Data Engineer, Machine Learning (Slack Search)

  • Design and develop scalable and resilient information retrieval infrastructure
  • Build and integrate scalable backend systems and data warehouse tools
  • Develop and maintain ETL processes
  • Collaborate with data scientists to deploy machine learning models
  • Optimize data storage and retrieval for real-time search
  • Monitor and troubleshoot data pipelines in production
  • Maintain and improve various data pipelines
  • Mentor other engineers and review code
  • Improve engineering standards, tooling, and processes

Requirements For Distributed Systems Data Engineer, Machine Learning (Slack Search)

Python
Java
Scala
Kubernetes
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field
  • 5+ years of relevant technical experience in data engineering with focus on search
  • Experience with search technologies (Elasticsearch, Solr, or Lucene)
  • Proficiency in Python, Java, or Scala
  • Experience with big data technologies (Airflow, EMR, Hadoop, Hive, Spark, Kafka)
  • Solid understanding of SQL and NoSQL databases
  • Experience with cloud platforms and containerization
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills

Benefits For Distributed Systems Data Engineer, Machine Learning (Slack Search)

  • Competitive salary and benefits package
  • Professional development and growth opportunities
  • Collaborative and inclusive work environment

Interested in this job?

Jobs Related To Slack Distributed Systems Data Engineer, Machine Learning (Slack Search)

Senior Business Intelligence Engineer II, AWS Sustainability Technology

Senior BI Engineer role at AWS focusing on sustainability technology, developing analytics tools for renewable energy and environmental initiatives.

Senior Business Intelligence / Data Visualization Engineer

Senior BI Engineer role at Apple focusing on data visualization and analytics for Apple Services, requiring 10+ years of experience and expertise in SQL, Python, and data visualization tools.

Senior Software Engineer, Data Platform Team, MSAN

Senior Software Engineer role at Microsoft's MSAN team, focusing on data platform development with competitive pay and hybrid work model.

IT Data Scientist

Senior Data Scientist role at Qualcomm focusing on large-scale data processing, machine learning, and analytics infrastructure development.

Data Platform Engineer

Data Platform Engineer role at ClassDojo, building data infrastructure to support global education technology platform reaching 45M+ children.