Principal AI Engineer - Context - Agents and Context

Elastic·United Kingdomsenior

In short

→Ingeniero de IA principal que mejora continuamente un motor de conocimiento para agents en producción.
→Diseña evaluaciones, telemetría y despliegues seguros para comportamientos de agentes en entornos reales.
→Destaca por liderar un ciclo de mejora end-to-end con impacto directo en productos de clientes.

Fluency in English required for collaboration and public code/design discussions.

In ~1 minute you get: who interviews you, the likely questions answered from your CV, and your CV tailored to this job. Free, no card.

🎧Land the interview? Bring the copilot. Our free extension listens to the live interview and flashes 3-4-word anchors from your resume and prep — glance, connect, talk. Get the extension →

What they ask for

✓10+ años en ingeniería de software con productos de IA en producción.
✓Experiencia comprobada en evaluación y mejora guiada por datos de agentes y LLM.
✓Capacidad para iterar con seguridad en prompts, skills y herramientas en producción.
✓Conocimiento directo de MCP: servidores y herramientas públicas.
✓Diseño y uso de telemetría para decisiones de producto y eng.
✓Liderazgo técnico: revisión de código, mentoría y propuestas técnicas.

Don't tick every box? That's normal — your free dossier shows your gaps and how to cover them in the interview.

TypeScriptElasticsearchMCPLangChainClaude CodeAgent BuilderPublic APIsCloud-based solutionsEvaluation frameworksTelemetry systems

Who should you write to at Elastic?

Your free dossier identifies the people who'd interview you — their background, what they value, and how to reach out so you stand out before applying.

Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI. What is The Role The Context Engine team builds the knowledge layer that AI agents use to work with enterprise data in Elasticsearch. We extract knowledge from any data sources into a structured AI Index, serve it to agents through public APIs, MCP tools and framework integrations, and close the loop with agent traces so that what the engine knows improves from real usage. Any agent can use it: Elastic’s own Agent Builder, Claude Code, LangChain and other third-party harnesses. As a Principal AI Engineer, you own the improvement loop of this product end to end: how agents, automations and skills behave in production, how we observe them, how we evaluate them, and how we ship changes to them safely. This is a hybrid role at the intersection of engineering, data science, and product. You will write production code, design evaluation and telemetry that product decisions can rest on, and set the technical bar for how the team iterates on agentic behaviour. You will work alongside data scientists, backend engineers, product, and UX, and your work will show up directly in what customers build on top of Elastic. The codebase is TypeScript and we build it in the open, so you'll be shipping code, designs and discussions in public alongside the rest of the Elastic Stack. What You Will Be Doing • Own the production improvement loop for Context Engine: understand how extraction automations, retrieval tools and memory behave, based on offline evaluations and customer conversations and telemetry. You help find the failure modes, fix them, and prove the fix. • Define how we iterate on agents and skills safely: versioning and rollout of prompts, skills and automations, regression coverage, staged and shadow evaluation, and the guardrails that let us change behaviour without breaking customers. • Design the telemetry we need to make data-informed engineering decisions: what to capture from agent traces, tool calls and knowledge retrieval, how it lands in Elasticsearch, and how it feeds evaluation, dashboards and the feedback loop. • Partner with the data science team on evaluation strategy: golden datasets, evaluators to gate on quality, latency and cost. • Raise the bar across the team: review designs and PRs, mentor engineers in eval-driven development, and write the technical proposals that shape the roadmap. What You Bring • 10+ years of software engineering experience, with the recent years spent shipping and operating AI-driven products on real production traffic, ideally products with public APIs and data models that had to evolve without breaking customers. • A track record of eval-driven product improvement: you have diagnosed agent or LLM behaviour from traces and user feedback, designed the evaluation that exposed the problem, shipped the fix and measured the outcome. • Direct experience building agents with state and memory, and iterating on prompts, skills and tool behaviour safely in production. • Familiarity with MCP, including exposing public MCP servers and tools. • Experience designing telemetry for AI systems, and using it to make engineering and product decisions. • Experience running product experi

Looking for something similar?

Leave your email and we'll alert you when matching jobs appear.

Don't apply unprepared

We research who's interviewing you, tailor your CV and rehearse you live — first one free.