📈 Performance KPIs
Accuracy≥ 85%
Precision≥ 83%
Recall≥ 87%
AUC-ROC≥ 0.90
Alert trigger3 consecutive days below
FrequencyDaily automated check
⚖️ Fairness KPIs
Demographic parity diff< 0.05
Equal opportunity TPR diff< 0.03
Disparate impact ratio> 0.80
Any breach actionRoute ALL to HITL
Breach notificationCAIO within 1 hour
FrequencyWeekly automated check
🔄 Data / Drift KPIs
Missing value rate< 1%
Schema drift alertWithin 1 hour
Feature PSI (warning)> 0.20
Feature PSI (critical)> 0.25 → model review
FrequencyContinuous + daily batch
🔒 Compliance KPIs
Low-confidence HITL routing100%
Audit log completeness> 99.9%
API uptime> 99.9%
Prediction latency p99< 200ms
Quarterly re-certificationGate 5 re-submit