MLOps
Operating the training-to-serving lifecycle of models you build: reproducible training, versioned data and features, tested deployment, and monitoring for the drift that degrades a model nobody touched.
Overview
Read the full MLOps guidance
Capabilities
Automated evaluation gate
A pipeline step that compares a candidate model with the incumbent on a held-out set and blocks a regression from shipping.
Drift monitoring
Watching input distributions and prediction behaviour against defined thresholds, because a model degrades while every infrastructure dashboard stays green.
Model Deployment
Versioned, evaluated, progressively rolled-out ML models with rollback.
Model deployment and rollback
Shipping and reverting model versions as a routine, exercised operation rather than an emergency improvisation.
Model registry
A single authoritative answer to which model version is in production, where it came from and what it was approved for.
Training reproducibility
Recording data version, code and configuration for every training run so a production model's result can be reproduced and therefore defended.
Training/serving feature consistency
Computing features identically in training and serving, closing the gap that is the most expensive recurring defect in production machine learning.
Practices
Champion/challenger comparison
Evaluating a candidate against the incumbent on the same data before promotion, so 'better' is a measurement rather than a belief.
Retraining cadence
A decided, reviewed schedule or trigger for retraining, rather than retraining when someone remembers or when a complaint arrives.
Metrics
Drift detection latency
Time between a meaningful shift in input or prediction distribution and someone being told about it.
Unit: days. Good direction: down.
Model deployment lead time
Time from an approved candidate model to it serving traffic, which is what determines how quickly a degraded model can be replaced.
Unit: hours. Good direction: down.
Model rollback time
Measured time to return to the previous model version, from an exercise rather than an estimate.
Unit: minutes. Good direction: down.
Training reproducibility rate
Share of production models whose training result can be reproduced from recorded data, code and configuration.
Unit: percent. Good direction: up.
Tools
Evidently
Open-source evaluation and monitoring for data and model quality, including drift reporting.
Visit site ↗Feast
Feature store that serves the same feature definitions to training and inference, closing the training/serving gap.
Visit site ↗Kubeflow
Machine-learning workflow toolkit for building and running training and serving pipelines on Kubernetes.
Visit site ↗MLflow
Experiment tracking and model registry giving a single answer to what is in production and where it came from.
Visit site ↗
Architecture patterns
Reference architectures and their trade-offs live in the blueprints library.
Maturity
- L1 ReactiveModels reach production by hand from a notebookrequired stage
Deployment is a person copying artifacts; the training run behind a live model cannot be reproduced and nothing watches its accuracy.
- L2 RepeatableTraining runs are recorded and rerunnablerequired stage
Data version, code and configuration are captured for each run, so a production model's result can be reproduced and defended.
- L3 StandardizedAn evaluation gate stands in the deployment pipeline
Candidates are compared with the incumbent on a held-out set and a regression blocks the pipeline rather than reporting into a void.
- L4 MeasuredInput and prediction drift are monitored to thresholds
Distribution shift is detected against defined thresholds with a named owner, rather than surfacing as a business complaint months later.
- L5 OptimizedRollback and retraining are exercised operations
Reverting to a previous model version and triggering a retrain are routine, recently practised procedures with measured durations.
Maturity for mlops is measured, not guessed — every score traces to your answers. See how maturity is scored.
Put it to work
Related Ops disciplines
- DataOps
DataOps enables this area
- AIOps
AIOps is a dependency of this area
- ModelOps
ModelOps complements this area
- AnalyticsOps
AnalyticsOps complements this area
Sources
- Tier 1 — PrimaryHidden Technical Debt in Machine Learning Systems ↗— NeurIPS (Sculley et al.)(verified 2026-09-20)
- Tier 1 — PrimaryMLflow Documentation ↗— MLflow / Linux Foundation(verified 2026-09-20)
- Tier 1 — PrimaryNIST AI Risk Management Framework (AI RMF 1.0) ↗— NIST(verified 2026-09-20)