Senior Software Engineer - Infrastructure and Tools

Databricks is the data and AI company that enables data teams to solve the world's toughest problems by building and running the world's best data and AI infrastructure platform.
$166,000 - $225,000
Backend
Senior Software Engineer
Hybrid
1,000 - 5,000 Employees
5+ years of experience
This job posting may no longer be active. You may be interested in these related jobs instead:
AWS FSx Lustre - SDE III, FSx

Senior Software Engineer role at Amazon Web Services, working on FSx for Lustre team in Boston, building high-performance cloud storage solutions.

Software Development Engineer, AWS FSx for Windows

Senior Software Engineer role at AWS FSx for Windows team, building distributed file system services with competitive pay $129,300-$223,600 and comprehensive benefits.

Software Development Engineer III, Aurora

Senior Software Engineer role at AWS Aurora team, building large-scale distributed database systems with focus on performance and reliability.

Innovation and Design Engineer, Worldwide Design and Engineering

Senior engineering role at Amazon focusing on designing innovative fulfillment centers and logistics systems, combining automation, robotics, and material handling expertise.

Sr Software Development Engineer, Internet Edge Services

Senior Software Engineer role at AWS developing packet processor data plane for Amazon's network edge, requiring 5+ years experience in software development and system architecture.

Description For Senior Software Engineer - Infrastructure and Tools

As a Senior Software Engineer on the Infrastructure teams at Databricks, you will build scalable systems to power the Databricks platform, making it the de-facto platform for running Big Data and AI workloads. You will build and extend the Databricks infrastructure platform, which includes multi-cloud systems and services for managing thousands of Kubernetes clusters at scale, storing petabytes of data, highly scalable and distributed API gateways, rate limiting framework, network security and encryption, developer tools and infrastructure (we use Bazel), testing frameworks, and scalable CI/CD framework among many others.

Your impact will include:

  • Building and extending components of the core Databricks infrastructure
  • Architecting multi-cloud systems and abstractions to allow the Databricks product to run on top of existing Cloud providers
  • Improving software development workflows for engineering and operational efficiency
  • Using Databricks' own data and AI platform to analyze build and test logs and metrics to identify areas for improvement
  • Developing automated build, test, and release infrastructures
  • Setting and upholding the standard for engineering processes to support high-quality engineering

We're looking for candidates with:

  • BS (or higher) in Computer Science, or a related field
  • 5+ years of experience writing production code in one of: Java, Scala, Go, C++ or Python
  • Passion for building highly scalable and reliable infrastructure
  • Experience architecting, developing and deploying large-scale distributed systems at scale
  • Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
  • Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes, or Terraform

Join us to work on cutting-edge infrastructure and make a significant impact in the world of Big Data and AI!

Last updated 8 months ago

Responsibilities For Senior Software Engineer - Infrastructure and Tools

  • Build and extend components of the core Databricks infrastructure
  • Architect multi-cloud systems and abstractions
  • Improve software development workflows for engineering and operational efficiency
  • Use Databricks' data and AI platform to analyze build and test logs and metrics
  • Develop automated build, test, and release infrastructures
  • Set and uphold standards for engineering processes

Requirements For Senior Software Engineer - Infrastructure and Tools

Java
Scala
Go
Python
Kubernetes
  • BS (or higher) in Computer Science, or a related field
  • 5+ years of experience writing production code in one of: Java, Scala, Go, C++ or Python
  • Experience architecting, developing and deploying large-scale distributed systems at scale
  • Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
  • Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes, or Terraform

Benefits For Senior Software Engineer - Infrastructure and Tools

Medical Insurance
Dental Insurance
Vision Insurance
401k
Equity
Parental Leave
  • Comprehensive health coverage including medical, dental, and vision
  • 401(k) Plan
  • Equity awards
  • Flexible time off
  • Paid parental leave
  • Family Planning
  • Gym reimbursement
  • Annual personal development fund
  • Work headphones reimbursement
  • Employee Assistance Program (EAP)
  • Business travel accident insurance

Interested in this job?