Acceptance criteria · contractual KPIs
Metrics
Every target is contractually agreed with ECB. Sparklines show 12-period trend; colour reflects target attainment.
Scope A · Agentic QA
Quality & velocity
Manual QA effort reduction
42%
target ≥ 40%On target
Automated test coverage (P1/P2)
78%
target ≥ 75%On target
Defect leakage to PROD
0.9× baseline
target ≤ 1× baselineOn target
CI/CD pipelines integrated
100%
target ≥ 100%On target
Triage accuracy
87%
target ≥ 85%On target
Mean time to PROD sanity
11min
target ≤ 15minOn target
LLM eval guardrail pass rate
96%
target ≥ 95%On target
Scope B · Requirements + Development
Analyst, architect & developer agents
Analyst effort reduction
38%
target ≥ 35%On target
Architect acceptance of AI designs
72%
target ≥ 70%On target
Missed requirements (trend)
6/sprint
target ≤ 8/sprintOn target
Downstream defects (trend)
14/release
target ≤ 18/releaseOn target
Code-review acceptance of AI PRs
73%
target ≥ 70%On target
SonarQube gate on AI PRs
100%
target ≥ 100%On target
Unit-test coverage on new code
83%
target ≥ 80%On target
Delivery predictability
91% on-time
target ≥ 85% on-timeOn target