Machine Learning Engineer

Listed as a remote role based in Frankfurt Rhine-Main Metropolitan Area. We're hiring on behalf of a Haystack partner! The Role • Build, operate, and continuously develop an AI-based knowledge platform, serving as the technological core for an AI Factory, ensuring reliable, performant, and cost-efficient LLM services in production. • Design and implement Retrieval-Augmented Generation (RAG) pipelines for real-world product use cases, covering document ingestion, indexing, retrieval, context preparation, and generative responses. • Construct, operate, and optimize vector databases and search infrastructures, ensuring clean data models, relevance, low latency, and robust monitoring. • Select, tune, and orchestrate embedding models and LLMs, managing their lifecycle and implementing AI workflows using frameworks like LangChain or LlamaIndex. • Shape architectural decisions, evaluation frameworks, and technical standards in collaboration with AI/ML engineering, application teams, and business units, integrating relevant Generative AI/LLM ecosystem developments. What You'll Need • Several years of experience building and operating RAG systems, search infrastructures, or knowledge-based platforms, ideally in a regulated or mission-critical environment. • A completed degree in Computer Science, Data Science, Computational Linguistics, Mathematics, or a comparable field, with a strong commitment to scientific and technical excellence. • Deep understanding of vector databases, embeddings, retrieval strategies, and LLM integration, with proven experience in building production-ready solutions. • Proficiency with cloud-based AI platforms (preferably Azure AI) and orchestration frameworks like LangChain, including monitoring, security, performance, and cost optimization. • A strong ownership mindset, excellent analytical and communication skills, and a passion for interdisciplinary collaboration to transform knowledge utilization in healthcare. What's On Offer • Competitive salary • Opportunities for continuous learning and professional development through tailored training programs. • Access to wellness facilities, including a modern gym and sports courses, to promote a healthy work-life balance. • Support for work-life integration, including flexible working arrangements and on-site childcare options. Apply via Haystack today! Show more Show less Seniority level Mid-Senior level Employment type Full-time Job function Information Technology Industries Technology, Information and Media