Anyscale commercializes Ray, an open-source project creating an ecosystem of libraries for scalable machine learning.

Anyscale is revolutionizing distributed computing through Ray, a popular open-source project powering scalable machine learning applications. With over $250 million in funding from prestigious investors like Andreessen Horowitz and NEA, Anyscale is trusted by industry giants including OpenAI, Uber, Spotify, Instacart, and Cruise.

The Ray Core team is seeking a talented Software Engineer to contribute to Ray's C++ backend, focusing on the distributed scheduler, language runtime integration, and I/O and memory subsystems. This role is crucial for maintaining Ray's reliability, scalability, and performance while supporting higher-level libraries and use cases.

As a Software Engineer on the Ray Core team, you'll work on optimizing large-scale workloads, developing stability and stress testing infrastructure, and improving fault tolerance. You'll be at the forefront of distributed systems development, contributing to a project that's shaping the future of AI applications.

The ideal candidate brings strong systems software experience, with at least 2 years of relevant work experience and expertise in building scalable, fault-tolerant distributed systems. Knowledge of distributed model training, inference, and GPU programming is highly valued. This is an exceptional opportunity to work on cutting-edge technology while making distributed computing accessible to developers of all skill levels.

Join Anyscale as a Software Engineer working on Ray Core, developing and maintaining the distributed system's C++ backend for high performance and reliability.

Software Engineer (Ray Core)

Anyscale, backed by prominent investors with $250+ million in funding, is revolutionizing distributed computing through Ray, their open-source project. They're seeking a Software Engineer for their Ray Data team to work on their Datasets library, which is crucial for machine learning pipelines and production use cases at major companies like Amazon and Alibaba.

The role involves developing and maintaining the Ray Datasets library, built on Apache Arrow and Ray Core. You'll work on performance optimization, ML training integration, stability testing, and streaming workload integration. The position requires expertise in distributed systems, data processing, and database internals.

This is an exciting opportunity to join a team that's making distributed computing accessible to developers of all skill levels. You'll contribute to open-source software used by industry leaders like OpenAI, Uber, and Spotify. The role offers competitive compensation ($170,112-$237,000) and comprehensive benefits including equity, healthcare, and education stipends.

The ideal candidate should have at least 2 years of experience, strong algorithmic background, and expertise in scalable systems. You'll be working in either San Francisco or Palo Alto, contributing to projects that directly impact the efficiency and accessibility of machine learning applications.

Working at Anyscale means being at the forefront of AI infrastructure development, with the opportunity to shape how distributed computing evolves. The company culture values technical excellence, innovation, and effective communication, as evidenced by the expectation to share knowledge through talks and blog posts.

Software Engineer position at Anyscale focusing on Ray Data library development, optimization, and scaling of distributed computing systems.

Software Engineer (Ray Data)

Anyscale commercializes Ray, a popular open-source project creating an ecosystem of libraries for scalable machine learning.

Anyscale, backed by Andreessen Horowitz, NEA, and Addition with $250+ million in funding, is revolutionizing distributed computing through Ray. We're seeking a Backend Software Engineer for our Workspace & Observability Team to build user-facing features for our AI platform. The role focuses on implementing core business logic and creating robust monitoring tools for AI applications.

The position involves working with observability in distributed clusters, tackling challenges in data ingestion, aggregation, and presentation. You'll be instrumental in developing the Ray Dashboard, library-specific observability tools, unified log viewers, and implementing anomaly detection systems. This is an opportunity to work with leading experts in distributed systems and machine learning.

The ideal candidate should have strong backend development skills, Python proficiency, and understanding of AI concepts. Experience with observability tools and distributed systems is valuable. We offer competitive compensation ($202,000-$237,000), comprehensive benefits including healthcare, 401k, and equity options.

Join us in democratizing distributed computing and making it accessible to developers of all skill levels. Our platform powers major companies like OpenAI, Uber, Spotify, and Instacart, accelerating AI applications in the real world. This role offers the chance to shape the future of AI application development while working with cutting-edge technology.

Backend Software Engineer position at Anyscale focusing on observability and monitoring tools for distributed AI applications, offering competitive salary and comprehensive benefits.

Software Engineer, Observability (Backend)

Anyscale, backed by Andreessen Horowitz, NEA, and Addition with $250+ million in funding, is revolutionizing distributed computing through Ray, their open-source project. The company seeks a Software Engineer for their Ray Data team to work on the Ray Datasets library, which is crucial for machine learning pipelines and production use cases at major companies like Amazon and Alibaba. The role involves developing and optimizing Ray's data processing capabilities, working with Apache Arrow and Ray Core, and collaborating closely with ML libraries. The position offers competitive compensation ($170,112-$237,000), comprehensive benefits, and the opportunity to work on cutting-edge distributed systems technology. The ideal candidate should have experience in distributed systems, data processing, and database internals, with a strong foundation in algorithms and system design. This role provides a unique opportunity to impact the future of distributed computing and machine learning infrastructure.

Software Engineer position at Anyscale focusing on Ray Data, building and optimizing distributed data processing capabilities for machine learning applications.

Anyscale, backed by Andreessen Horowitz, NEA, and Addition with $250+ million in funding, is revolutionizing distributed computing through Ray, their open-source project. They're seeking a Senior Software Engineer for their Distributed Training team to develop and maintain core ML libraries like Ray Train and Ray Tune. The role involves building scalable ML infrastructure used by major companies like OpenAI, Uber, and Spotify.

The position requires 5+ years of experience in production software systems and offers a competitive salary range of $170,112-$237,000. The ideal candidate will have strong ML framework knowledge, distributed systems experience, and architectural skills. They'll work on creating fault-tolerant ML libraries, engaging with the open-source community, and collaborating with global ML teams.

The role provides comprehensive benefits including healthcare (99% covered), 401k, stock options, parental leave, and education stipends. Based in San Francisco or Palo Alto, this opportunity offers the chance to shape the future of ML infrastructure while working with industry experts. The position combines technical leadership with hands-on development, making it perfect for those passionate about scaling ML applications.

Senior Software Engineer role at Anyscale focusing on building distributed training infrastructure for machine learning applications, offering competitive compensation and comprehensive benefits.

Software Engineer - Model Training Infrastructure

Anyscale commercializes Ray, a popular open-source project for scalable machine learning, making distributed computing accessible to developers.

Anyscale is revolutionizing distributed computing through Ray, a powerful open-source project creating an ecosystem of libraries for scalable machine learning. With backing from major investors like Andreessen Horowitz and NEA, having raised over $250 million, Anyscale is trusted by industry giants like OpenAI, Uber, Spotify, Instacart, and Cruise.

The ML Development Platform team creates essential tools and services enabling users to build production-quality applications using Ray. This role is central to creating the primary interface into Anyscale's ecosystem, focusing on delivering a magical developer experience through polished, stable, and well-designed products.

As a Software Engineer on the ML Developer Platform team, you'll be responsible for building and maintaining critical infrastructure components, including Anyscale workspaces, production and development tools, ML Ops tools, and various integrations. The position requires both technical expertise and user empathy to create solutions that serve everyone from newcomers to Ray to enterprises running production workloads.

The ideal candidate combines strong backend development skills with machine learning infrastructure knowledge, capable of building robust systems while understanding the needs of ML practitioners. You'll be working at the intersection of distributed systems and machine learning, helping shape the future of AI development tools and infrastructure.

Join us in democratizing distributed computing and making advanced AI capabilities accessible to developers of all skill levels. This is an opportunity to work with leading experts in the field while contributing to both open-source and commercial products that are transforming how AI applications are built and deployed.

Build next-gen ML Ops platform and development tooling at Anyscale, working with distributed systems and machine learning experts to democratize AI development.

Software Engineer - ML Developer Platform

Commercializing Ray, an open-source project for scalable machine learning, making distributed computing accessible to developers.

Anyscale, backed by major investors with $250+ million in funding, is revolutionizing distributed computing through Ray, their open-source project. They're seeking a Software Engineer to join their Infrastructure team, focusing on building the next generation of tools for distributed AI applications. The role involves working on both control plane and data plane development, requiring expertise in Kubernetes and cloud-native infrastructure. The position offers the unique opportunity to work on open-source Ray and their proprietary infinite laptop product.

The Infrastructure team is responsible for creating the scalable backbone that powers Anyscale's cloud platform. You'll be involved in designing and implementing critical infrastructure components, optimizing performance, and ensuring robust system operation. The role requires strong technical skills in distributed systems, cloud technologies, and programming languages like Go and Python.

This is an excellent opportunity for someone passionate about distributed systems and AI infrastructure. You'll work with leading experts in the field, contributing to technology used by major companies like OpenAI, Uber, and Spotify. The position offers competitive compensation ($202,000-$237,000) and comprehensive benefits, including equity, healthcare, and various allowances. The hybrid work environment in San Francisco provides flexibility while maintaining collaborative opportunities.

Software Engineer role at Anyscale focusing on infrastructure development for distributed AI applications, offering competitive salary and comprehensive benefits.

Software Engineer, Infrastructure

Anyscale commercializes Ray, a distributed computing framework, making it accessible to developers and powering AI applications for major tech companies.

Anyscale, backed by Andreessen Horowitz, NEA, and Addition with $250+ million in funding, is revolutionizing distributed computing through Ray, their open-source project. They're seeking a Senior Full-Stack Software Engineer for their Foundation Team, focusing on Enterprise Governance and Security.

The role involves building enterprise-grade tools for security, observability, and integrations at scale. You'll be instrumental in shaping AI governance by developing robust systems for access control, cost management, and automation. The position requires expertise in SSO, RBAC, IAM, and permission systems, along with experience in cost tracking and billing systems.

Anyscale's mission is to democratize distributed computing and make it accessible to developers of all skill levels. Their technology powers AI applications for major companies like OpenAI, Uber, Spotify, Instacart, and Cruise. The platform provides critical guardrails for enterprise AI deployment, ensuring security, control, and observability at scale.

As part of the Foundation Team, you'll collaborate with users and product teams to deliver solutions that enhance productivity while maintaining security standards. The role offers an opportunity to work at the intersection of AI infrastructure and enterprise governance, helping organizations adopt and deploy AI responsibly and efficiently.

The ideal candidate will have 5+ years of full-stack engineering experience, preferably in enterprise SaaS or fintech, with strong technical skills and excellent communication abilities. You'll be joining a company that's at the forefront of AI infrastructure, backed by top-tier investors, and working on technology that powers some of the most innovative AI applications in the world.

Senior Full-Stack Software Engineer role at Anyscale, focusing on Enterprise Governance and Security, building tools for AI infrastructure security and observability.

Software Engineer, Enterprise Governance (Full-Stack)

Anyscale, backed by prominent investors with $250+ million in funding, is revolutionizing distributed computing through Ray, their open-source project. As a Technical Services Engineer, you'll be at the forefront of helping customers implement and succeed with their ML/AI initiatives. The role combines technical expertise in ML/AI, customer advocacy, and problem-solving skills.

The position requires working from the San Francisco office three days a week (Mon, Tue, Thur) in a hybrid setup. You'll be responsible for being the technical advisor for key customers, managing their onboarding and adoption of the Anyscale platform. The role involves end-to-end ownership of customer issues, from troubleshooting to resolution, while participating in a follow-the-sun support model.

The ideal candidate brings 5+ years of customer-facing technical experience, with at least 2 years in a fast-paced startup environment. Strong knowledge of ML/AI, data engineering, and cloud platforms is essential. You'll work with industry leaders like OpenAI, Uber, Spotify, and Instacart who use Ray in their tech stacks.

This role offers competitive compensation ($119,360 - $186,857) plus comprehensive benefits including stock options, healthcare coverage, 401k, wellness and education stipends, and more. It's an opportunity to impact the future of distributed computing and AI while working with cutting-edge technology and prominent customers.

The position requires excellent communication skills, strong technical capabilities, and the ability to manage multiple customer needs simultaneously. You'll collaborate with product and engineering teams to improve the platform while building strong relationships with technical stakeholders. Experience with Ray, MLOps platforms, and LLMs is a plus.

Technical Services Engineer role at Anyscale, focusing on customer success with ML/AI platform implementation and support.

Technical Services Engineer

Anyscale is commercializing Ray, a popular open-source project for scalable machine learning, democratizing distributed computing for software developers.

At Anyscale, we're building the best place to run Ray, democratizing distributed computing for software developers of all skill levels. We're seeking a Senior Full-Stack Software Engineer to join our Foundation Team, focusing on Enterprise Governance and Security. In this role, you'll shape the future of AI governance by building enterprise-grade tools for security, observability, and integrations at scale. You'll work on projects such as developing secure access and permissions systems, cost and usage optimization, and ensuring high levels of observability and automation within AI and ML-driven applications. We're looking for candidates with 5+ years of full-stack software engineering experience, expertise in SSO, RBAC, IAM, and permission systems, and familiarity with cost tracking and billing systems. Anyscale offers competitive compensation, including stock options, comprehensive healthcare, 401k, wellness and education stipends, paid parental leave, and flexible time off. Join us in transforming how enterprises leverage AI responsibly and efficiently.

Senior Full-Stack Software Engineer for Enterprise Governance and Security at Anyscale, building AI governance tools and secure systems.

Anyscale is on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We're commercializing Ray, a popular open-source project creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, and Cruise use Ray in their tech stacks to accelerate AI applications.

As a Consulting Engineer at Anyscale, you'll be a core member of the team, contributing to customer implementations across the ML Ops lifecycle. Your responsibilities will include technical architecture assessment, model design and testing, deployment architectures, integration, debugging, and production operations. You'll also deliver classroom-based training, work with cross-functional teams, and influence the product roadmap.

The ideal candidate has:
- BS, MS, or PhD in Computer Science or related fields (or equivalent experience)
- 5+ years of hands-on experience delivering services to customers
- Excellent knowledge of Machine Learning and Deep Learning architectures and frameworks
- Experience with Python, MLOps, DevOps, virtualization, Docker, and Kubernetes in cloud environments
- Strong presentation, communication, and collaboration skills

Anyscale offers competitive compensation and benefits, including:
- Salary range: $222,010 - $275,057 per year
- Stock Options
- Comprehensive healthcare plans (99% covered for employees and dependents)
- 401k Retirement Plan
- Wellness and Education stipends
- Paid Parental Leave and Time Off
- Commute reimbursement
- In-office meals covered

Join Anyscale and be part of a team that's shaping the future of distributed computing and AI applications!

Join Anyscale as a Consulting Engineer to democratize distributed computing and advance AI applications using Ray.

Consulting Engineer

Anyscale is on a mission to democratize distributed computing and make it accessible to software developers of all skill levels by commercializing Ray, a popular open-source project for scalable machine learning.

Anyscale is seeking talented engineers to join their team and contribute to the development of next-generation, high-performance machine learning serving systems. The Platform team is dedicated to creating world-class systems for serving ML models in production, including building and maintaining the open-source Ray Serve library and contributing directly to the Anyscale platform.

As part of this role, you will:
- Develop a highly available service for ML model serving
- Enhance Ray Serve and other libraries to simplify the development of next-generation ML applications in production
- Improve autoscaling capabilities to drive performance enhancements and cost savings
- Optimize latency and throughput for both single- and multi-model serving scenarios

Requirements:
- Solid background in algorithms, data structures, and system design
- Experience working with modern machine learning tooling, including PyTorch, TensorFlow, and JAX
- At least 2+ years of relevant work experience

Bonus points for:
- Experience in building and maintaining open-source projects
- Experience in building and operating machine learning infrastructure in production
- Experience in building highly available serving systems

Anyscale offers competitive compensation and benefits, including:
- Target salary range: $170,112 ~ $237,000
- Stock Options
- Healthcare plans (99% premiums covered)
- 401k Retirement Plan
- Wellness and Education stipends
- Paid Parental Leave
- Flexible Time Off
- Commute reimbursement
- 100% of in-office meals covered

Anyscale is based in San Francisco, CA, with employees required to come to the office 3x a week. The company values diversity and inclusion and encourages individuals from underrepresented groups to apply.

Join Anyscale as a Software Engineer (ML Platform) to develop high-performance machine learning serving systems and contribute to Ray Serve.

Anyscale Engineering Jobs

Anyscale commercializes Ray, an open-source project creating an ecosystem of libraries for scalable machine learning.