Distributed Systems Data Engineer, Machine Learning (Slack Search)

Slack is a technology company revolutionizing workplace communication and information discovery through advanced search and collaboration tools.
Data
Senior Software Engineer
In-Person
5+ years of experience
AI · Enterprise SaaS

Description For Distributed Systems Data Engineer, Machine Learning (Slack Search)

Slack is seeking a Search Infrastructure Data Engineer to join their Core Infrastructure organization, focusing on revolutionizing information discovery and search technologies. This role is crucial in building cutting-edge search technologies that deliver relevant and personalized results to users.

The position sits at the intersection of Search Infrastructure and Machine Learning Infrastructure, where you'll be responsible for designing, building, and maintaining data infrastructure and pipelines that power search and recommendation systems. The Core Infrastructure team is fundamental to Slack's functionality, managing the information retrieval infrastructure that supports Search, ML, and various product experiences.

As a Search Infrastructure Data Engineer, you'll work with cutting-edge technologies including Elasticsearch, Kubernetes, and various big data tools. You'll collaborate closely with data scientists and ML engineers to deploy machine learning models for semantic retrieval, while also maintaining and optimizing data pipelines for production environments.

The ideal candidate brings 5+ years of relevant experience in data engineering with a focus on search, along with expertise in programming languages like Python, Java, or Scala. Knowledge of big data technologies, cloud platforms, and strong problem-solving skills are essential. The role offers opportunities to work on innovative search technologies while contributing to a positive, diverse, and supportive culture where curiosity and collaboration are valued.

This position offers competitive compensation, professional growth opportunities, and the chance to work with a collaborative team that values smart, humble, and hardworking individuals. Join Slack to help build the future of workplace information discovery and search technology.

Last updated 16 days ago

Responsibilities For Distributed Systems Data Engineer, Machine Learning (Slack Search)

  • Design and develop scalable and resilient information retrieval infrastructure
  • Build and integrate scalable backend systems and data warehouse tools
  • Develop and maintain ETL processes
  • Collaborate with data scientists to deploy machine learning models
  • Optimize data storage and retrieval for real-time search
  • Monitor and troubleshoot data pipelines in production
  • Maintain and improve various data pipelines
  • Mentor other engineers and review code
  • Improve engineering standards, tooling, and processes

Requirements For Distributed Systems Data Engineer, Machine Learning (Slack Search)

Python
Java
Scala
Kubernetes
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field
  • 5+ years of relevant technical experience in data engineering with focus on search
  • Experience with search technologies (Elasticsearch, Solr, or Lucene)
  • Proficiency in Python, Java, or Scala
  • Experience with big data technologies (Airflow, EMR, Hadoop, Hive, Spark, Kafka)
  • Solid understanding of SQL and NoSQL databases
  • Experience with cloud platforms and containerization
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills

Benefits For Distributed Systems Data Engineer, Machine Learning (Slack Search)

  • Competitive salary and benefits package
  • Professional development and growth opportunities
  • Collaborative and inclusive work environment

Interested in this job?

Jobs Related To Slack Distributed Systems Data Engineer, Machine Learning (Slack Search)

Senior Business Intelligence Engineer, Sales Insights & Recommendations

Senior Business Intelligence Engineer role at Amazon Advertising, focusing on data analysis and BI solutions for sales team effectiveness.

Sr. Data Engineer, Customer Engagement Technology

Senior Data Engineer position at Amazon focusing on customer service technology, requiring 5+ years experience in data engineering, offering competitive salary and benefits.

Senior Business Intelligence Engineer, Supply Chain, Placement Analytics

Senior BI Engineer role at Amazon focusing on supply chain optimization and inventory placement analytics, requiring 10+ years experience with competitive compensation.

Business Intelligence Engineer, Infra-Finance Business Intelligence & Transformations

Senior Business Intelligence Engineer role at AWS, focusing on analytics platform development for Infrastructure Supply Chain Finance organization.

Clinical Data Engineer

Senior Clinical Data Engineer position at Apple's Biophotonics group, focusing on bio-sensing technologies and clinical data platform development.