Research Engineer (Evals)

TLDR: We're looking for a research engineer to build and maintain our internal suite of benchmarks, covering single/multi-turn content and agentic guardrails. The research engineer would also work with the team on projects studying agent behaviours in the wild. About us White Circle https://whitecircle.ai/ is an AI Safety company building the safety, reliability, and optimization layer for AI systems. At the core of our platform are policies – simple natural-language rules that define what an AI model should and shouldn’t do. We automatically test, enforce, and continuously improve these policies at scale. - We’ve raised $11M from top funds, founders, and senior leaders at OpenAI, Anthropic, HuggingFace, Mistral, DeepMind, Datadog, Sentry, and others - We process over 100M+ API calls every month - We fine-tune and train our own LLMs so they run faster and cheaper than any open or proprietary model We’re a small, highly focused team. If you want to work deeply on hard problems, see your work ship to production quickly, and influence how AI safety is actually built – you’re the one we need. About the team White Circle's fundamental research team works on the science of how AI systems fail in the real world: where agents break, how misalignment actually looks like to the end user, and how it is present in the model internals. We build the evals, benchmarks, environments, and tooling that empirically study high-impact agent reliability concerns — some of which become the guardrails shipped in our products, and some of which become public writeups. You will: - Own and maintain our internal benchmark suite, covering single/multi-turn content guardrails and agentic safety. - Build benchmarks that distinguish specific model capabilities. - Work with the product team to build evals covering core functionality of our flagship models. - Build benchmarks for new features coming out of the research team. - Adapt and extend evals to new verticals and changing product data. - Work