Senior Software Engineer - Agent Safety / Evals - AI Foundations

Kraken · London, UKsenior

In short

▸Desarrollas sistemas de seguridad y evaluación para agentes de IA internos en Kraken.
▸Tu trabajo diario incluye crear marcos de evaluación, guardrails y monitoreo para garantizar que los agentes de IA operen de forma segura y predecible.
▸Destacado: Trabajas en un equipo nuevo enfocado en la infraestructura fundamental que permite usar IA de forma segura a toda la organización.

Fluent written and spoken English required

In ~1 minute you get: who interviews you, the likely questions answered from your CV, and your CV tailored to this job. Free, no card.

🎧Land the interview? Bring the copilot. Our free extension listens to the live interview and flashes 3-4-word anchors from your resume and prep — glance, connect, talk. Get the extension →

What they ask for

✓Experiencia avanzada en ingeniería de software con propiedad end-to-end de componentes complejos.
✓Conocimiento práctico de Python en producción.
✓Experiencia comprobada en evaluación y seguridad de modelos de lenguaje (LLM).
✓Fortaleza en diseño de sistemas, seguridad y arquitectura de software.
✓Capacidad para tomar decisiones técnicas y mentorar a otros ingenieros.
✓Experiencia con AWS en producción (deploy, operación y optimización).

Don't tick every box? That's normal — your free dossier shows your gaps and how to cover them in the interview.

PythonAWSLLMsGenerative AIEvaluation FrameworksGuardrailsSecurityObservabilityMonitoringAuthentication

Who should you write to at Kraken?

Your free dossier identifies the people who'd interview you — their background, what they value, and how to reach out so you stand out before applying.

Help us use technology to make a big green dent in the universe! Kraken powers some of the most innovative global developments in energy. We create the technology that redefines utilities and unlocks a new energy system of the future. By optimising renewable generation, building a more intelligent grid, and empowering utilities to deliver an exceptional customer experience, our operating system is transforming the industry worldwide. It’s an incredibly exciting time to work in energy. Join us on our mission to improve the lives of ONE BILLION humans within the decade and shape a cleaner, better future for everyone. Technologies as we look to expand our existing capabilities. A crucial part of this is broadening the foundational infrastructure that enables teams across the organisation to use AI effectively and accelerate our mission. You'll work in the Agent Safety team. We build the shared platforms, harnesses, and guardrails that enable engineering and product teams to safely, reliably, and deterministically use machine learning and generative AI agents for internal systems and workflows across the business. This is a delivery-focused team that sits at the intersection of engineering, security, and internal enablement. 🏡 Where you’ll fit in We're hiring a Senior Software Engineer to join our newly formed Agent Safety / Evals team. As AI agents take on more autonomous tasks across Kraken's internal workflows, you will help ensure they do so securely, predictably, and within clearly defined operational boundaries. This is a hands-on senior individual-contributor role. Working with the Lead Software Engineer and the broader AI team, you will own substantial parts of our evaluation, safety, and reliability stack - turning technical direction into production systems, contributing to architecture decisions, and raising engineering standards through thoughtful collaboration and mentoring. 🚀 What you'll own Build internal agent-safety systems: Design and implement services that improve the reliability, security, and determinism of LLMs and autonomous agents, keeping them within expected operational boundaries Develop robust evaluation frameworks: Build scalable harnesses and evals for internal workflows and AI skills. Define meaningful test cases, interrogate output quality, and improve the reproducibility of the systems used to measure it Implement guardrails and governance controls: Develop pre- and post-generation controls and translate agreed governance requirements into maintainable software across internal tools and platforms Strengthen AI security and observability: Engineer authentication and permission patterns for internal agents, improve monitoring and tracing, and contribute to operational playbooks for AI-specific anomalies Support verification and red teaming: Design tests and participate in continuous verification and red-teaming exercises to identify prompt injection, data-access, and unpredictable-behaviour risks before they reach production Operate services in AWS: Deploy, run, and support high-throughput, low-latency safety services; make sound architecture, reliability, and cost trade-offs; and work effectively with platform, techops, and security partners Raise the engineering bar: Contribute to technical decisions, review designs and code, mentor other engineers, and help establish pragmatic patterns that can be reused across AI Foundations 🧠 What you bring to the party Strong senior-level software engineering: Proven experience owning complex components or services end to end, from design and implementation through testing, deployment, and operation Deep engineering fundamentals: Strong judgement around system design, concurrency, security, testing, and architecture trade-offs.

Don't apply unprepared

We research who's interviewing you, tailor your CV and rehearse you live — first one free.