Member of Technical Staff, Agent Infrastructure Engineer

Training and deploying frontier models for developers and enterprises building AI systems for content generation, semantic search, RAG, and agents.
$150,000 - $250,000
Backend
Staff Software Engineer
Remote
501 - 1,000 Employees
5+ years of experience
AI

Description For Member of Technical Staff, Agent Infrastructure Engineer

Cohere is at the forefront of AI development, training and deploying frontier models for developers and enterprises. This role focuses on scaling LLM Agents that interact with the digital world to solve real tasks with minimal human oversight. As a Member of Technical Staff, Agent Infrastructure Engineer, you'll be instrumental in designing and implementing novel environments that scale gracefully and enable state-of-the-art model evaluation. The position offers unique opportunities with one of the highest compute-to-engineers ratios globally, where the line between engineering and research is fluid. You'll work with cutting-edge technology, contribute to both production code and research, and have access to substantial compute resources and data. The team primarily operates in GMT/CET timezones, with offices in major tech hubs while maintaining remote flexibility. The role combines technical expertise in distributed systems, ML infrastructure, and high-performance computing with research opportunities in AI. You'll be part of a diverse team of world-class professionals working on advancing AI technology while maintaining a strong focus on practical applications and customer value. The position offers comprehensive benefits, flexible work arrangements, and the opportunity to shape the future of AI technology.

Last updated 9 days ago

Responsibilities For Member of Technical Staff, Agent Infrastructure Engineer

  • Design and write high-performant and scalable code, that allows fast training and sampling
  • Read latest papers, implement those ideas that are relevant and run experiments
  • Research, implement, and experiment with ideas on our super compute and data infrastructure
  • Learn from and work with the best researchers in the field

Requirements For Member of Technical Staff, Agent Infrastructure Engineer

Kubernetes
  • Extremely strong software engineering skills
  • Experience in HPC environment and auto-scaling
  • Experience with container orchestration platforms (e.g. docker, kubernetes)
  • Experience using large-scale distributed training strategies
  • Intrinsic motivation to build better tooling
  • Pragmatism balancing fast-moving project requirements with quality
  • Familiarity with autoregressive sequence models, such as Transformers

Benefits For Member of Technical Staff, Agent Infrastructure Engineer

Dental Insurance
Medical Insurance
Mental Health Assistance
Parental Leave
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits
  • Mental health budget
  • 100% Parental Leave top-up for 6 months
  • Personal enrichment benefits
  • Remote-flexible work
  • Co-working stipend
  • 6 weeks of vacation

Interested in this job?

Jobs Related To Cohere Member of Technical Staff, Agent Infrastructure Engineer

Senior/Staff Software Engineer, North

Senior/Staff Software Engineer position at Cohere, building the North AI workspace platform, focusing on Python development and AI agent implementation with emphasis on security and performance.

Member of Technical Staff, Agent Infrastructure Engineer

Staff-level Agent Infrastructure Engineer position at Cohere, focusing on scaling LLM agent frameworks and implementing novel environments for state-of-the-art models.

Engineering Project Manager (SAP Finance), IS&T Enterprise Systems

Lead SAP Finance project management role at Apple, focusing on implementing and managing financial systems for global e-commerce operations.

Manager, Software Developer in Test, Creativity Apps

Lead QA engineering team for Apple's Creativity Apps, managing test automation and quality processes for iOS/macOS applications with competitive compensation and benefits.

Technical Lead, Privacy

Technical Lead position at Axon focusing on privacy and data compliance systems, offering hybrid work and competitive compensation.