As a Senior Software Engineer on the Infrastructure teams at Databricks, you will build scalable systems to power the Databricks platform, making it the de-facto platform for running Big Data and AI workloads. You will build and extend the Databricks infrastructure platform, which includes multi-cloud systems and services for managing thousands of Kubernetes clusters at scale, storing petabytes of data, highly scalable and distributed API gateways, rate limiting framework, network security and encryption, developer tools and infrastructure (we use Bazel), testing frameworks, and scalable CI/CD framework among many others.
Your impact will include:
- Building and extending components of the core Databricks infrastructure
- Architecting multi-cloud systems and abstractions to allow the Databricks product to run on top of existing Cloud providers
- Improving software development workflows for engineering and operational efficiency
- Using Databricks' own data and AI platform to analyze build and test logs and metrics to identify areas for improvement
- Developing automated build, test, and release infrastructures
- Setting and upholding the standard for engineering processes to support high-quality engineering
We're looking for candidates with:
- BS (or higher) in Computer Science, or a related field
- 5+ years of experience writing production code in one of: Java, Scala, Go, C++ or Python
- Passion for building highly scalable and reliable infrastructure
- Experience architecting, developing and deploying large-scale distributed systems at scale
- Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
- Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes, or Terraform
Join us to work on cutting-edge infrastructure and make a significant impact in the world of Big Data and AI!