Member of Technical Staff, Agent Infrastructure Engineer

Training and deploying frontier models for developers and enterprises building AI systems for content generation, semantic search, RAG, and agents.
Backend
Staff Software Engineer
Remote
AI

Description For Member of Technical Staff, Agent Infrastructure Engineer

Cohere is at the forefront of AI development, training and deploying frontier models for developers and enterprises. This role focuses on scaling LLM Agent frameworks and implementing novel environments for state-of-the-art models. As a Member of Technical Staff, you'll be working with one of the highest compute-to-engineers ratios in the world, contributing to both production code and research.

The position offers a unique opportunity to work on cutting-edge AI technology, specifically in designing and implementing scalable environments for evaluating state-of-the-art models and supporting the sampling of millions of trajectories for synthetic data creation. The role bridges engineering and research, with no strict delineation between the two disciplines.

The ideal candidate will have strong software engineering skills, experience with HPC environments, container orchestration, and distributed training strategies. Knowledge of autoregressive sequence models like Transformers is essential. The team operates primarily in GMT or CET time zones, making this position ideal for candidates in compatible locations.

Working at Cohere means joining a diverse team of researchers, engineers, and designers who are passionate about their craft and considered among the best in their fields. The company provides extensive benefits, including health and dental coverage, mental health support, parental leave, and flexible working arrangements. With offices in major tech hubs and a remote-friendly culture, Cohere offers an inclusive environment focused on scaling intelligence to serve humanity.

The role offers significant growth potential, working alongside top researchers in the field and access to substantial compute resources and data infrastructure. Even if candidates don't perfectly match all requirements, Cohere encourages applications from those passionate about the mission and ready to contribute to advancing AI technology.

Last updated 18 hours ago

Responsibilities For Member of Technical Staff, Agent Infrastructure Engineer

  • Design and write high-performant and scalable code for fast training and sampling
  • Read latest papers, implement relevant ideas and run experiments
  • Research, implement, and experiment with ideas on compute and data infrastructure
  • Work with researchers in the field

Requirements For Member of Technical Staff, Agent Infrastructure Engineer

Kubernetes
  • Extremely strong software engineering skills
  • Experience in HPC environment and auto-scaling
  • Experience with container orchestration platforms (docker, kubernetes)
  • Experience using large-scale distributed training strategies
  • Familiarity with autoregressive sequence models, such as Transformers

Benefits For Member of Technical Staff, Agent Infrastructure Engineer

Dental Insurance
Medical Insurance
Mental Health Assistance
Parental Leave
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits
  • Mental health budget
  • 100% Parental Leave top-up for 6 months (Canada, US, and UK)
  • Personal enrichment benefits
  • Remote-flexible with offices in multiple locations
  • Co-working stipend
  • 6 weeks of vacation

Interested in this job?

Jobs Related To Cohere Member of Technical Staff, Agent Infrastructure Engineer

Construction Manager, North America Customer Fulfillment (NACF) Central Region

Remote Construction Manager position at Amazon overseeing fulfillment center construction and renovation projects across Canada, offering competitive salary and benefits.

Systems Engineer II, Prime Air

Systems Engineer II position at Amazon Prime Air, combining software development with DO-178 certification expertise for innovative delivery solutions.

Americas Operations - Software Development Manager

Lead software development team at Apple's Americas Operations, focusing on full-stack development and supply chain solutions.

Software Engineer, Infrastructure

Senior Infrastructure Engineer role at Meta, building scalable backend systems for billions of users with competitive compensation and benefits.

Program Manager, Wallet & Apple Pay Operations

Lead program management role for Apple Pay & Wallet operations, focusing on partner integration, process improvement, and global operational excellence.