QAOps
The quality function as an operating discipline: deciding what to test at which layer, running defect triage, analysing escaped defects, and setting the gates that a change must pass.
Overview
Read the full QAOps guidance
Capabilities
Defect triage
A severity definition specific enough that two people classify the same issue the same way.
Escaped defect analysis
Examining every production defect for the gap that let it through, and changing something as a result.
Layered test strategy
A written, revisited view of what is tested at which layer and why, rather than coverage following whatever is easy to automate.
Production quality feedback
Routing errors, support contacts and user reports back into where testing effort is spent.
Release quality gates
Explicit, risk-proportionate conditions a change must meet, with exceptions recorded rather than negotiated silently.
Practices
Escaped defect review
A regular session examining what reached production and which layer should have caught it.
Triage calibration
Having two people triage the same issues periodically to check the severity definition still means one thing.
Metrics
Change Failure Rate
Share of deployments causing degraded service requiring remediation.
Unit: %. Good direction: down.
Escaped defect rate
Defects found in production per release, the direct measure of what testing did not catch.
Unit: defects per release. Good direction: down.
Triage agreement rate
Share of issues two people independently assign the same severity, testing whether the definition means anything.
Unit: percent. Good direction: up.
Triage latency
Time from a defect being reported to it being classified and assigned.
Unit: hours. Good direction: down.
Tools
Allure Report
Test reporting that aggregates history, making flake and failure patterns visible across runs.
Visit site ↗Jira
Issue tracker commonly used for defect triage, severity workflow and escaped-defect analysis.
Visit site ↗Playwright
Browser automation framework with tracing and retry controls useful for diagnosing and containing flakiness.
Visit site ↗
Architecture patterns
Reference architectures and their trade-offs live in the blueprints library.
Maturity
- L1 ReactiveQuality is whatever the last person checkedrequired stage
There is no written view of what is tested where, and readiness is judged by feel.
- L2 RepeatableDefect severity is defined and applied consistentlyrequired stage
Two people classify the same issue the same way, which makes every downstream number mean something.
- L3 StandardizedTesting strategy per layer is written and revisited
Effort follows a decision about risk rather than whatever was easiest to automate.
- L4 MeasuredEvery escaped defect is analysed for the gap
Production defects are treated as the highest-quality feedback available and change where effort goes.
- L5 OptimizedGates are explicit, proportionate and rarely bypassed
Release conditions match risk, exceptions are recorded, and production signals feed the strategy continuously.
Maturity for qaops is measured, not guessed — every score traces to your answers. See how maturity is scored.
Put it to work
Related Ops disciplines
- TestOps
TestOps complements this area
- ReleaseOps
ReleaseOps complements this area
Sources
- Tier 1 — PrimaryISO/IEC/IEEE 29119 — Software Testing ↗— ISO/IEC/IEEE(verified 2026-09-20)
- Tier 2 — AuthoritativeDORA — State of DevOps Research ↗— Google / DORA(verified 2026-09-20)
- Tier 2 — AuthoritativeISTQB — Certified Tester Foundation Level Syllabus ↗— ISTQB(verified 2026-09-20)