A platform for creating, deploying, and running machine learning models, making AI accessible to every software developer.

Replicate is revolutionizing AI accessibility by building the premier platform for creating, deploying, and running machine learning models. As an Infrastructure Engineer on the Platform team, you'll be at the forefront of making generative AI available to developers worldwide.

The role involves managing the complete lifecycle of ML models, from packaging and deployment to serving, scaling, and monitoring. You'll be working with a platform that supports thousands of models and handles millions of daily predictions. This position offers a unique opportunity to build innovative solutions where your decisions have direct impact.

The technical stack includes Python, Go, Node.js, Kubernetes, Terraform, and databases like Redis, Google BigQuery, and PostgreSQL. You'll be working on critical infrastructure components, including multi-regional traffic management, GPU optimization, and sophisticated task allocation systems.

The ideal candidate brings experience in platform development at scale, understanding of complex systems architecture, and proven ability with Kubernetes operations. While ML/AI production experience is a plus, the role focuses on infrastructure rather than model building. Strong communication skills are essential as you'll be collaborating closely with teams and translating complex concepts into actionable insights.

Based in Replicate's Mission district office in San Francisco, this role offers the chance to be part of building a strong in-person culture while working on cutting-edge AI infrastructure. You'll be joining a team dedicated to democratizing AI technology and making it accessible to developers everywhere.

Infrastructure Engineer role at Replicate, building and maintaining scalable platforms for AI model deployment and serving, based in San Francisco.

Infrastructure Engineer

Platform for creating, deploying, and running machine learning models, making AI accessible to every software developer.

Replicate is revolutionizing the AI landscape by making machine learning accessible to every software developer, not just tech giants. As an Infrastructure Engineer on the Platform team, you'll be at the forefront of democratizing AI technology.

The role involves building and maintaining the critical infrastructure that supports thousands of models and powers millions of predictions daily. You'll be working with cutting-edge technologies including Python, Go, Node.js, Kubernetes, and various databases to create robust, scalable systems.

Your responsibilities will span the entire lifecycle of ML models, from packaging and deployment to serving and monitoring. You'll design systems to maximize GPU utilization, implement multi-regional failover capabilities, and optimize model inference through various techniques. The position requires strong technical expertise in platform development and Kubernetes, combined with excellent communication skills.

The company, founded in 2019, has a strong engineering-led culture with alumni from prestigious tech companies like Docker, Dropbox, GitHub, and NVIDIA. They're committed to building in public and contributing to the open-source community, making AI technology more accessible and safer through better tools and safeguards.

This is an opportunity to make a significant impact in the AI infrastructure space, working with a team that values technical excellence and practical innovation. The role offers flexibility with remote work options, though there's a preference for PST timezone alignment and hybrid work from the San Francisco office.

The ideal candidate will bring experience in platform development, distributed systems, and a passion for developer tools. While ML/AI experience is not required, familiarity with serving ML models in production or working with GPU-intensive workloads would be valuable. You'll be joining a mission-driven team that's not just building nice things, but aiming to transform how AI technology is deployed and used across the industry.

Infrastructure Engineer role at Replicate focusing on building and maintaining ML/AI platform infrastructure and model serving capabilities.

Replicate builds the best platform for creating, deploying, and running machine learning models, making AI accessible to every software developer.

At Replicate, we're on a mission to democratize AI for every software developer. Our goal is clear: to build the best platform for creating, deploying, and running machine learning models. As an Infrastructure Engineer on our Platform team, you'll be at the forefront of making generative AI accessible to all.

The Platform team at Replicate is responsible for the entire lifecycle of models, from packaging and deployment to serving, scaling, and monitoring. You'll be developing the infrastructure that supports thousands of models and powers millions of predictions daily. This is an opportunity to build something truly innovative, where your decisions have a tangible impact and your creativity can shine.

As an Infrastructure Engineer, you'll be:
- Designing and building our deployment and model-serving platform
- Building technology to operate the latest advancements in ML and AI
- Designing systems to maximize the utilization and reliability of our Kubernetes clusters and GPUs, including multi-regional traffic shifting and failover capabilities
- Owning and optimizing fair and reliable task allocation and queuing across diverse customers with heterogeneous workloads
- Working with our Models team to speed up model inference through techniques like caching, weights management, machine configurations, and runtime optimizations in Python and PyTorch
- Working with technologies such as Python, Go, Node.js, Kubernetes, Terraform, Redis, Google BigQuery, and PostgreSQL

The ideal candidate will have:
- Experience building platforms at scale
- Worked in complex systems with many moving parts
- Designed and implemented developer-friendly APIs
- Hands-on experience setting up and operating Kubernetes
- A passion for building tools that empower developers
- Strong communication and collaboration skills
- At least 3 years of full-time software engineering experience

We're particularly interested in candidates who have:
- Worked on machine learning platform teams
- Experience putting ML/AI into production
- Exposure to serving Generative AI features where GPUs are costly commodities

This role offers flexibility with remote work options (anywhere in the United States) or in-person work, with a preference for Pacific/Mountain time zones. If possible, we encourage coming into our San Francisco office at least 3 days a week.

Join us at Replicate and be part of a team that's making AI accessible and empowering developers worldwide!

Join Replicate as an Infrastructure Engineer to build the best platform for creating, deploying, and running ML models, making AI accessible to all developers.

You'll be helping our customers build cool stuff on Replicate. You'll be pointing them in the right direction, solving gnarly technical problems, but you'll also be showing them how to build with AI.

There are going to be boring bits of the job ("my credit card's not working") but you'll also be automating as much of this as possible so you can work on the interesting things.

We're looking for the right person, not just someone who checks boxes, so you don't need to satisfy all of these things. But, you've probably got these qualities:

- Outstanding communication skills. You'll be the face of the company.
- Strong engineering skills. You don't need decades of experience, but you do need to confidently debug a customer's problem.
- You tinker with AI. You're going to be helping our customers build with AI, and you're going to be automating as much of your job as you can.
- Scrappy, creative energy. You need to do whatever it takes to make something work for customers, as quickly as possible.

About Replicate:

What we're doing:
Machine learning can now do some extraordinary things: it can understand the world, drive cars, write code, make art. But, it is still extremely hard to use. Research is typically published as a PDF, with scraps of code on GitHub and weights on Google Drive (if you're lucky!). It is near-impossible to take that work and apply it to a real-world problem, unless you are an expert.

We're making machine learning accessible to everyone. People creating machine learning models should be able to share them in a way that other people can use, and people who want to use machine learning should be able to do it without getting a PhD.

With great power also comes great responsibility. We believe that with better tools and safeguards, we will make this powerful technology safer and easier to understand.

How we work:
We're a bunch of hackers, engineers, researchers, and artists. We obsess about the details of API design and the right words for things. We're defining how AI works so we'd better get it right. We make fast and reliable infrastructure. That's what a good infrastructure product is. We're not afraid to build things from scratch to make it the fastest.

We use AI for work. We use AI for play. We find unexplored parts of the map and create new techniques ourselves. We open-source it all. We build in public, for the community. We want AI to work like open-source software so everyone benefits from it.

We're led by engineers. We all write code. (Or, we get ChatGPT to help.) There aren't any meetings about meetings. We've worked at places like Docker, Dropbox, GitHub, Heroku, NVIDIA, Scale AI, and Spotify. We've created technologies like Docker Compose and OpenAPI.

We're here to build a big company. We're ambitious and hard-working. We're not here to just build nice things.

Customer Engineer at Replicate, helping customers build with AI and solve technical problems.

Customer Engineer

At Replicate, we're building the best way to deploy and operate machine learning models. We're looking for a Full Stack Product Engineer to help us create an exceptional user experience across every phase of the software development lifecycle - from coding to publishing, operating, monitoring, and administration. You'll be the bridge between design and functionality, crafting intuitive experiences that bring our vision to life.

We're looking for the right person, not just someone who checks boxes, so you don't need to satisfy all of these things. But, you might have some of these qualities:

- You thrive in the "back of the front-end" space, seamlessly integrating API and database changes with sleek user interfaces. You have experience partnering with designers to fully scope out and deliver features that involve complex user interactions.
- You excel at evolving complex web applications, balancing the need for rapid iteration with long-term maintainability and scalability.
- You have a user-centric mindset, and are passionate about building delightful software that "just works" for our customers. You can traverse the stack to refine the experience and polish out rough edges.
- Excellent communication skills. We think most of being a programmer is not programming. We want you to be able to communicate complex topics clearly, write down your thinking, write good docs, etc.

You might be particularly good for this job if:

- You have deep experience with React and Typescript. You're comfortable rolling up your sleeves and tackling complex UI problems, diagnosing and fixing performance issues, and building with accessibility in mind.
- You've helped decompose a monolithic web app into separate API and client applications. You've seen this kind of problem before and have opinions/cautionary tales/ideas about how best to tackle this.
- You have experience designing and implementing RESTful APIs, and can discuss the pros and cons of different API design patterns.
- You've worked on scaling full-stack applications and can articulate strategies for improving performance on both the frontend and backend as data and user load increases.
- You can discuss state management in React and explore tradeoffs between local state and context, or external libraries like Redux or React Query.

Extra bonus if:

- You have experience building and maintaining design systems or component libraries.
- It might be handy if you've dabbled in machine learning, or just have general curiosity about it.

Tech you'll be working with:

- Frontend: React, React Query, Remix, and TypeScript
- Backend: Python/Django and Node.js for server-side logic and API services
- Infrastructure: AWS and CloudFlare, with a particular focus on CloudFlare Workers

This role is based in our San Francisco office in the Mission. We don't have a strict in-office schedule, but we like people to come in at least 3 days a week.

Join Replicate as a Full Stack Engineer to build exceptional user experiences for machine learning model deployment and operation. Work with React, TypeScript, Python, and more in a supportive environment.

Full Stack Engineer

Replicate is seeking a Systems Performance Engineer to optimize complex systems and AI infrastructure. The ideal candidate has a deep passion for squeezing every ounce of performance out of systems, whether it's rendering AAA game titles or optimizing large-scale distributed systems.

Key qualifications:
- Mastery of C++ and systems programming
- Experience with high-performance computing environments
- Comfort with parallel programming models (multi-threading, SIMD, GPU programming)
- Track record of optimizing large-scale production deployments
- Curiosity about new technologies and optimization techniques
- Excellent problem-solving skills

Ideal candidates may have experience in:
- Optimizing rendering pipelines for games or real-time graphics
- High-frequency trading systems
- Contributing to performance-critical open-source projects
- Profiling and optimizing across different hardware architectures

While AI/ML experience isn't required, candidates should be excited to apply their optimization skills to this domain. The role involves translating expertise in cycles, memory management, and systems-level thinking to the challenges of optimizing AI model inference and training.

Replicate offers:
- Remote-first work environment with an office in San Francisco
- Competitive salary and above-market equity
- Good healthcare benefits

About Replicate:
Replicate is making machine learning accessible to everyone by enabling easy sharing and use of ML models. They aim to simplify the process of applying ML research to real-world problems, making it possible for non-experts to leverage this technology. The company values creating an inclusive, supportive work environment with the best people.

Replicate is seeking a Systems Performance Engineer to optimize complex systems and AI infrastructure.

Replicate Engineering Jobs

A platform for creating, deploying, and running machine learning models, making AI accessible to every software developer.