AI Engineer, Product

Mistral.ai · Parismid

En corto

▸Ingeniero de IA enfocado en mejorar características de producto como búsqueda, chat o documentos mediante pruebas rigurosas y experimentación.
▸Día a día: diseñar evaluaciones, optimizar prompts, gestionar despliegues con canary/shadow y monitorear rendimiento en producción.
▸Destacado: poseer responsabilidad total sobre la calidad del IA en tu área, desde definir qué es 'bueno' hasta lanzar mejoras.

English speaking roles available in France

En ~1 minuto te damos: quién te entrevista, las preguntas probables con respuestas desde tu CV, y tu CV adaptado a esta vacante. Gratis, sin tarjeta.

🎧¿Llegás a la entrevista? Llevá el copiloto. Nuestra extensión escucha la entrevista en vivo y te muestra anclas de 3-4 palabras desde tu CV y tu preparación — mirás, conectás, hablás. Gratis. Ver la extensión →

¿Qué piden?

✓3-4 años de experiencia en ML o software con experiencia en producción de LLMs.
✓Habilidades sólidas en TypeScript o Python.
✓Experiencia práctica con prompts, system prompts y llamadas a funciones (tool/function calling).
✓Capacidad para diseñar métricas de evaluación y ejecutar A/B testing con toma de decisiones basada en datos.
✓Experiencia con observabilidad: logging, tracing, dashboards y alertas.
✓Enfoque productivo: hipotética, experimentación, interpretación de resultados y impacto en producción.

¿No cumplís todo? Es lo normal — tu dossier gratis te dice qué gaps tenés y cómo cubrirlos en la entrevista.

TypeScriptPythonLLMsPromptsSystem promptsTool/function callingA/B testingObservabilityStructured loggingTracing

¿A quién escribirle en Mistral.ai?

Tu dossier gratis identifica a las personas que te entrevistarían — con su background, qué valoran y cómo escribirles para destacar antes de aplicar.

About Mistral Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems—across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector—co-creating customized AI systems that they can run on their terms. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. The Role Embedded directly in a product team as search, chat, documents, or audio, you'll improve AI-powered features through rigorous evaluation, prompt and orchestration design, and rapid experimentation. You'll own your domain's AI quality end-to-end: define what "good" looks like, measure it, run experiments, and ship what works. Work with Science to deliver measurable improvements to quality, latency, safety, and reliability. What You Will Do • Design and run evaluations for your product area: reference tests, heuristics, model-graded checks tailored to search relevance, chat quality, document understanding, or audio performance. • Define and track metrics that matter: task success, helpfulness, hallucination proxies, safety flags, latency, cost. • Own prompt and orchestration design: write, test, and iterate on prompts and system prompts as a core part of your work. • Run A/B tests on prompts, models, and configurations; analyze results; make rollout or rollback decisions from data. • Set up observability for LLM calls: structured logging, tracing, dashboards, alerts. • Operate model releases: canary and shadow traffic, sign-offs, SLO-based rollback criteria, regression detection. • Improve core behaviors in your product area, whether that's memory policies, intent classification, routing, tool-call reliability, or retrieval quality. • Create templates and documentation so other teams can author evals and ship safely. • Partner with Science to diagnose regressions and lead post-mortems. What We're Looking For • 3-4 years of experience; backgrounds that fit well include ML engineers moving closer to product, or software engineers with real AI/ML production experience. • Strong TypeScript or Python skills - we have both tracks depending on team fit. • Production LLM experience: prompts, tool/function calling, system prompts. • Hands-on with evals and A/B testing; you can design metrics, not just run them. • Comfortable implementing directly in product code, not only notebooks. • Observability experience: logging, tracing, dashboards, alerting. • Product mindset: form hypotheses, run experiments, interpret results, ship. • Clear communication, autonomous, and oriented toward production impact over experimentation for its own sake. It would be ideal if you also have: • Safety systems experience: moderation, PII handling/redaction, guardrails. • Release operations: canary/shadowing, automated rollbacks, experiment platforms. • Prior work on search ranking, chat systems, document AI, or audio ML features. We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks. For the most up-to-date details on benefits available in your location, please refer to our Benefits page . Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy . Find more English Speaking Jobs in France on Arbeitnow

No apliques sin prepararte

Investigamos quién te entrevista, adaptamos tu CV y te ensayamos en vivo — gratis la primera.