Senior Software Engineer, AI

AT KLUE https://klue.com/, WE’RE BUILDING THE FUTURE OF COMPETITIVE INTELLIGENCE 👋 KLUE ENGINEERING IS HIRING! We're looking for a Senior Software Engineer to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You will be leading the design and development of search and retrieval agent systems that enable users to generate compete insights for their business. In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for LLM-powered retrieval and generation workflows. You will shape how we integrate retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning loops to deliver fast, accurate, and trusted search experiences at scale. WHAT YOU'LL DO - Build and ship backend systems that power agentic workflows. You design retrieval pipelines, orchestration layers, and multi-step agent architectures that turn millions of competitive data points (news, press releases, webpage changes, Slack posts, emails, reviews, CRM data) into actionable intelligence for our customers. - Own evaluation of agentic systems at scale. You develop and operate evaluation frameworks (automated, offline, and human-in-the-loop) that measure relevance, quality, latency, and end-to-end task success across our agent pipelines. You'll define what "good" looks like and build the infrastructure to measure it continuously. - Design and optimize retrieval and ranking systems. You work across hybrid retrieval, re-ranking, query rewriting, and post-retrieval synthesis to ensure our agents surface the right information at the right time. You understand the tradeoffs between BM25, dense retrieval, and hybrid approaches and know when each matters. - Improve LLM-powered workflows end to end. From prompt design and retrieval strategy to caching and latency optimization, you'll make our agent response