Software Engineer II, AI

AT KLUE https://klue.com/, WE’RE BUILDING THE FUTURE OF COMPETITIVE INTELLIGENCE 👋 KLUE ENGINEERING IS HIRING! We're looking for a Software Engineer, AI to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You'll be joining us at an exciting time as we reinvent our insight generation systems, making this an excellent opportunity for someone with strong Backend and ML fundamentals who wants to dive deep into practical LLM applications. As a member of our team, you'll be leading the design and implementation of search and retrieval agent systems that enable users to discover high-quality, relevant information with minimal effort. You will work at the intersection of LLM-powered agent workflows, retrieval pipelines, and evaluation frameworks, ensuring that our systems remain scalable, efficient, and aligned with user intent. WHAT YOU'LL DO - Design and implement retrieval-augmented generation (RAG) systems with agentic workflows to refine query understanding, document retrieval, and response synthesis. - Build and optimize retrieval pipelines using BM25, dense retrieval, hybrid retrieval, and re-ranking approaches. - Develop evaluation pipelines for retrieval and generation, including offline metrics (recall, MRR, nDCG) and human-in-the-loop evaluations. - Experiment with query rewriting, expansion, and classification to improve retrieval relevance. - Collaborate closely with Product to bring ML-powered search agents into production. - Profile, debug, and optimize the latency, accuracy, and scalability of retrieval and generation components. - Contribute to the design of data pipelines for training retrieval and ranking models, including dataset curation, augmentation, and labeling workflows. - Stay up-to-date with advancements in LLMs, retrieval techniques, and agent architectures, evaluating opportunities to integrate them into our systems. WHAT YOU BRING - Softwa