Quality Systems Lead

Encord · Londonsenior

En corto

▸Liderazgo en calidad de datos para sistemas automáticos y equipos de auditoría en India.
▸Combina ingeniería de evaluación automática con gestión operativa de calidad en datos de AI.
▸La calidad se convierte en funcionalidad nativa del producto, no solo herramientas internas.

Fluent English required for cross-team collaboration.

En ~1 minuto te damos: quién te entrevista, las preguntas probables con respuestas desde tu CV, y tu CV adaptado a esta vacante. Gratis, sin tarjeta.

🎧¿Llegás a la entrevista? Llevá el copiloto. Nuestra extensión escucha la entrevista en vivo y te muestra anclas de 3-4 palabras desde tu CV y tu preparación — mirás, conectás, hablás. Gratis. Ver la extensión →

¿Qué piden?

✓Experiencia en construcción y operación de sistemas de evaluación automatizada de calidad de datos.
✓Capacidad para liderar, capacitar y gestionar un equipo de auditoría de 10 personas en India.
✓Dominio de estadística práctica: diseño de muestreo, estadísticas de acuerdo entre evaluadores.
✓Habilidades para definir estándares de calidad con rubros, conjuntos de oro y criterios de aceptación.
✓Experiencia en integrar métricas de calidad en plataformas de software como funcionalidad nativa.
✓Capacidad para rotar entre escribir código y moderar reuniones de calibración con equipos remotos.

¿No cumplís todo? Es lo normal — tu dossier gratis te dice qué gaps tenés y cómo cubrirlos en la entrevista.

LLM-based screeningModel-assisted evaluationAgreement analysisAnomaly detectionDrift detectionSampling designInter-rater agreementGold setsQuality scoring systemsAutomated evaluation pipelines

¿A quién escribirle en Encord?

Tu dossier gratis identifica a las personas que te entrevistarían — con su background, qué valoran y cómo escribirles para destacar antes de aplicar.

About us Encord is the universal data layer for AI that helps 300+ AI teams train and run models on the right data. Our platform indexes, curates, annotates, and evaluates data across the full AI lifecycle, from development through production. Trusted by Woven by Toyota, AXA, UiPath, Zipline, and more. We're an ambitious team of 100+ working at the frontier of AI and have raised $60M in Series C funding from Wellington Management, CRV, Next47 and Y Combinator. The role We're hiring a Quality Systems Lead to own how Encord measures the quality of the human data we deliver to frontier AI labs, physical AI companies and enterprise AI teams — the standard itself, the systems that evaluate against it, and the audit function that produces the ground truth behind both. Data quality is what our customers buy. As we scale across data types — image and video, document, medical, LLM evaluation, robot teleoperation, egocentric capture — quality coverage cannot scale linearly with headcount. So this role has two halves that make each other work. You will build automated evaluation: model-assisted and LLM-based screening, agreement analysis at scale, anomaly and drift detection across annotation output. And you will build and run a dedicated audit team of around ten specialists in India, whose judgements become the labelled ground truth that trains and calibrates that automated layer. As coverage automates, the audit team moves up to the cases models can't judge and to generating gold sets for each new data type we take on. It is an unusual combination — engineering and consistent QC operations in one person — and it is the combination the job needs. You will also have an advantage your counterparts elsewhere in the industry don't: Encord owns the platform this work runs on, so the measurement you build can become native capability in the product rather than internal tooling. What you'll do Build automated dataset quality evaluation and root-cause detection — model-assisted and LLM-as-judge screening, agreement analysis at scale, anomaly and drift detection across annotation output Hire, train, calibrate and manage a dedicated audit team of around ten specialists based in our India operation, held to inter-rater agreement and catch rate rather than volume audited Turn audit output into labelled ground truth that trains and validates the automated layer, and manage the ratio of automated to manual coverage deliberately over time Own the quality standard for every data type we deliver — written rubrics with worked edge cases, golden sets, and acceptance criteria agreed with the customer, alongside the Special Projects lead, before the first batch ships Build scoring systems that rank annotator and reviewer performance and feed routing, staffing and offboarding decisions Set the pass thresholds that certification gates on, so nobody works a project queue without having demonstrated they meet the standard Report quality KPIs to leadership, and into the reporting our Special Projects leads take to customers: accuracy against client spec, inter-annotator agreement, rework rate, cost of rework, and coverage Work with Project Management on remediation — you produce the measurement and the diagnosis, production owns fixing the project, and the standard stays independent of the people being measured Own the unit economics of quality: cost per audited unit, and the coverage you buy per pound spent Partner with Product and Engineering to bring quality measurement into Encord platform as native capability Who we're looking for You build and you operate.

No apliques sin prepararte

Investigamos quién te entrevista, adaptamos tu CV y te ensayamos en vivo — gratis la primera.