Research Engineer, Pretraining

Anthropic is a leading AI research company focused on creating reliable, interpretable, and steerable AI systems. Our mission is to ensure that transformative AI systems are aligned with human interests and are safe and beneficial for users and society as a whole. We are seeking a Research Engineer to join our Pretraining team, responsible for developing the next generation of large language models.

In this role, you will work at the intersection of cutting-edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems. Key responsibilities include designing and implementing high-performance data processing infrastructure for large language model training, developing core processing primitives, building robust systems for data quality assurance, implementing monitoring systems, and creating optimized distributed computing systems for processing web-scale datasets.

The ideal candidate will have strong software engineering skills, expertise in Python and distributed computing frameworks, deep understanding of cloud computing platforms, experience with high-throughput system design, and excellent problem-solving and communication skills. Preferred qualifications include an advanced degree in Computer Science, experience with language model training infrastructure, and expertise in tokenization algorithms.

At Anthropic, we work as a single cohesive team on large-scale research efforts, valuing impact over smaller, specific puzzles. We view AI research as an empirical science and greatly value communication skills. Our work continues in the directions of GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in San Francisco. We are committed to fostering a diverse and inclusive workplace and strongly encourage applications from candidates of all backgrounds, including those from underrepresented groups in tech.

If you're passionate about pushing the boundaries of AI while prioritizing safety and ethics, we want to hear from you!