Software Engineer, Infrastructure

Commercializing Ray, an open-source project for scalable machine learning, making distributed computing accessible to developers.
$202,000 - $237,000
Cloud
Mid-Level Software Engineer
Hybrid
101 - 500 Employees
3+ years of experience
AI · Enterprise SaaS

Description For Software Engineer, Infrastructure

Anyscale, backed by major investors with $250+ million in funding, is revolutionizing distributed computing through Ray, their open-source project. They're seeking a Software Engineer to join their Infrastructure team, focusing on building the next generation of tools for distributed AI applications. The role involves working on both control plane and data plane development, requiring expertise in Kubernetes and cloud-native infrastructure. The position offers the unique opportunity to work on open-source Ray and their proprietary infinite laptop product.

The Infrastructure team is responsible for creating the scalable backbone that powers Anyscale's cloud platform. You'll be involved in designing and implementing critical infrastructure components, optimizing performance, and ensuring robust system operation. The role requires strong technical skills in distributed systems, cloud technologies, and programming languages like Go and Python.

This is an excellent opportunity for someone passionate about distributed systems and AI infrastructure. You'll work with leading experts in the field, contributing to technology used by major companies like OpenAI, Uber, and Spotify. The position offers competitive compensation ($202,000-$237,000) and comprehensive benefits, including equity, healthcare, and various allowances. The hybrid work environment in San Francisco provides flexibility while maintaining collaborative opportunities.

Last updated 2 months ago

Responsibilities For Software Engineer, Infrastructure

  • Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments
  • Optimize control plane components for large-scale, distributed AI/ML workloads
  • Build intelligent scheduling and resource management systems
  • Develop features to enhance reliability, performance, scalability, and observability
  • Support and optimize accelerator integration
  • Handle container image management and dependency resolution
  • Participate in code reviews and architecture discussions
  • Provide on-call support and troubleshoot infrastructure issues
  • Collaborate with distributed systems and ML experts

Requirements For Software Engineer, Infrastructure

Go
Python
Kubernetes
  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 3+ years of experience writing high-quality production code
  • Experience in building and maintaining highly available, scalable distributed systems
  • Expertise in cloud-native technologies and Kubernetes-based deployments
  • Deep understanding of networking, security, and authentication in cloud environment
  • Familiarity with observability stacks
  • Proficiency in Go and Python
  • Knowledge of low-level operating system foundations

Benefits For Software Engineer, Infrastructure

Equity
Medical Insurance
401k
Education Budget
Parental Leave
Commuter Benefits
  • Stock Options
  • Healthcare plans covered 99% by Anyscale
  • 401k Retirement Plan
  • Education & Wellbeing Stipend
  • Paid Parental Leave
  • Fertility Benefits
  • Flexible Time Off
  • Commute reimbursement
  • 100% of in office meals covered

Interested in this job?

Jobs Related To Anyscale Software Engineer, Infrastructure

Software Engineer III - Cloud Engineer - AWS, Terraform & Python

Cloud Engineer position at JPMorgan Chase focusing on AWS, Terraform, and Python development with emphasis on database management and cloud migration.

Network Developer 2

Network Developer 2 position at Oracle focusing on cloud infrastructure, network engineering, and systems automation with competitive compensation and benefits.

Cloud Engineer

Cloud Engineer position at Elpedison, Greece's leading energy utility, focusing on cloud infrastructure design and management with hybrid work options.

Software Developer 3

Senior Software Developer role at Oracle's Cloud Infrastructure team, focusing on distributed systems and cloud services development.

Cloud Support Engineer

Cloud Support Engineer position at SZNS Solutions, providing technical support and solutions for cloud infrastructure, with focus on GCP, security, and customer service.