Senior Backend Engineer, AI / ML
Description For Senior Backend Engineer, AI / ML
Klue, a rapidly growing VC-backed SaaS company backed by Tiger Global and Salesforce Ventures, is seeking a Senior Backend Engineer to join their ML Foundation and Platform team in Toronto. This role focuses on building and optimizing state-of-the-art LLM-powered agents that can reason, plan, and automate workflows for users. The position comes at an exciting time as the company reinvents its insight generation systems.
The role requires expertise in Python and extensive experience with LLMs, retrieval systems, and ML platforms. You'll be responsible for leading the design and implementation of LLM-based agents, creating platforms for ML capabilities, and deploying services to production. The work involves measuring and improving retrieval systems, developing APIs, and implementing benchmarking systems for prompts.
Klue offers a competitive compensation package including a salary range of CA$170K – CA$200K, equity options, and comprehensive benefits. The company has been recognized as one of Canada's Most Admired Corporate Cultures and has won multiple awards for its tech culture and rapid growth. The position offers a hybrid work environment, with team members expected in the office at least 2 days per week.
The ideal candidate will have 5+ years of software engineering experience, strong ML fundamentals, and a proven track record of leading large cross-team initiatives. They should be comfortable taking ownership of ambiguous problems, rapidly learning new areas, and maintaining a balance between scientific rigor and practical business impact. The role provides an opportunity to work with cutting-edge technologies including various LLM platforms, ML frameworks, and modern MLOps tools.
Join a team that values builders who can take ownership, learn rapidly, and bring both scientific rigor and pragmatic focus to their work. This position offers the chance to shape the future of competitive enablement while working with state-of-the-art ML technologies.
Responsibilities For Senior Backend Engineer, AI / ML
- Lead design and implementation of LLM-based agents
- Create platform for teams to utilize ML capabilities
- Deploy ML services to production
- Measure and improve retrieval systems
- Develop APIs and scalable systems
- Build machine learning services and data pipelines
- Implement benchmarking systems for prompts
- Collaborate cross teams to identify LLM solution needs
- Build and optimize state-of-the-art LLM-powered agents
Requirements For Senior Backend Engineer, AI / ML
- Expertise in Python
- 5+ years of software engineering experience
- 3+ years building and optimizing retrieval systems
- Deep understanding of LLMs, retrieval metrics and their trade-offs
- Experience implementing memory and tool-use strategies for LLM-based agents
- Experience building end-to-end systems as a Platform Engineer, MLOps Engineer, or Data Engineer
- Strong understanding of software testing, benchmarking, and continuous integration
- Knowledge of query augmentation and content enrichment strategies
- Expertise in automated LLM evaluation
- Skilled at prompt engineering
- Track record of staying current with ML research
Benefits For Senior Backend Engineer, AI / ML
- Extended health & dental benefits from Day 1
- Employee Stock Option Plan
- Flexible PTO (2-4 weeks average)
- Direct access to leadership team
- Hybrid work environment
Jobs Related To Klue Senior Backend Engineer, AI / ML
