$ cat jobs/senior-ai-scientist-sporty-group-b824939fb6ef.json
Senior AI Scientist
About the role We are looking for a Senior AI Scientist to continuously improve the quality, accuracy and effectiveness of our AI-powered products. You will analyse AI interactions, identify improvement opportunities and optimise conversational behaviour, prompting strategies and retrieval mechanisms. Working closely with AI Engineers, you will drive measurable improvements in AI performance and user satisfaction. What you'll be doing Analyse AI conversations and identify opportunities to improve response quality and user experience. Design, implement and evaluate prompt engineering strategies. Optimise RAG pipelines and retrieval quality. Evaluate different LLMs and recommend the most effective models for specific use cases. Potentially train customer personal models. Define and monitor AI quality metrics, including accuracy, relevance, latency and user satisfaction. Design and execute experiments to validate AI improvements. Analyse user feedback and interaction data to continuously improve AI behaviour. Collaborate with AI Engineers to deploy validated improvements into production. Maintain evaluation frameworks, benchmarks and documentation. Stay current with advances in generative AI and recommend practical improvements to existing products. What you'll bring 5+ years of experience in AI, ML, NLP or a related field. Strong understanding of LLMs and conversational AI. Experience with prompt engineering, prompt evaluation and LLM optimisation. Experience evaluating conversational AI systems using qualitative and quantitative methods. Strong Python and SQL skills. Strong analytical and problem-solving skills. Excellent communication and stakeholder management skills. Proactive mindset with strong ownership and accountability. Experience with speech and voice AI technologies. Experience with AI evaluation frameworks and benchmarking. Experience with vector databases and embedding models. Knowledge of AI governance, safety and responsible AI practices. Experience wo
Similar remote roles
Software Engineer
Additude AB · Worldwide · mid
Machine learning Engineer
Sia · Worldwide · mid
FULL STACK SOFTWARE ENGINEER (AI-NATIVE)
R8 TECHNOLOGIES · Worldwide · mid
Sr. Data Scientist
saks off 5th · APAC · senior
Trainee,Advanced Analytics
saks off 5th · APAC · junior
Director of Engineering, Operations Planning
HelloFresh · Canada · mid
Analista de Testes Sênior (QA) (Home Office)
somos bhs · LATAM · mid
Senior Business Insights Engineer
saks off 5th · APAC · senior