Founding Engineer: Large-Scale Web Scraping & Crawling

Foundry is building the first end-to-end testing platform for web agents, including a Browser Gym for RL-driven optimization. As a Founding Web Scraping Engineer, you'll be instrumental in building internet-scale web crawling infrastructure capable of handling millions of domains and evolving anti-bot defenses.

The role focuses on designing robust, distributed crawling systems that adapt dynamically to web changes, optimize for efficiency, and ensure reliable data extraction. You'll be responsible for building large-scale crawlers, developing adaptive scraping systems, solving captchas at scale, and managing proxy rotations.

We're looking for someone with expert-level experience in web scraping & crawling, using tools like Selenium, Puppeteer, Playwright, and Scrapy. Deep knowledge of anti-bot detection strategies and hands-on expertise with captcha-solving strategies is essential. You should be proficient in Python, Go, or JavaScript and have experience with high-performance, parallelized scraping frameworks.

As a YC-backed team, we're offering a founding role where you'll define and own our web crawling infrastructure from day one. You'll be working at internet scale, building systems that dynamically adapt across millions of domains. This is an opportunity to join a cutting-edge startup that's creating something entirely new in the web agent testing space.

The position offers competitive compensation ($100K - $200K) plus equity (1.00%), and we're open to remote work within the US. If you're passionate about large-scale web automation and want to be part of a founding team setting new standards in web agent testing, this role offers the perfect opportunity to make a significant impact.