Software Engineer - Tokens: Data Acquisition Team Lead

Anthropic is seeking a Software Engineer to lead the "Tokens: Data Acquisition" team, focusing on large-scale web crawling and data partnerships. This role is crucial for Anthropic's mission to create reliable, interpretable, and steerable AI systems. The team is responsible for acquiring internet data through web crawling and partnerships to support Anthropic's research and product development.

The position involves leading efforts to develop and maintain an internet-scale web crawler, build data ingestion pipelines, and improve system observability. The ideal candidate will have strong experience with distributed systems and understanding of web crawling complexities, including data privacy and technical considerations.

Anthropic operates as a public benefit corporation, emphasizing collaborative research and development in AI safety. The company values impact-driven work and approaches AI research as an empirical science. Team members work cohesively on large-scale research efforts, with frequent research discussions and a strong emphasis on communication skills.

The role offers competitive compensation, comprehensive benefits, and the opportunity to work in a hybrid environment from their San Francisco office. Anthropic encourages applications from diverse candidates and values different perspectives in their mission to develop beneficial AI systems. The company has a strong research foundation, building on work in areas like GPT-3, Circuit-Based Interpretability, and AI Safety.

This position is ideal for someone passionate about AI's transformative potential and interested in building large-scale systems for information acquisition. The role combines technical expertise with the opportunity to contribute to Anthropic's mission of developing safe and beneficial AI systems.