TRACE:衡量生产级 AI 系统中可解释性债务的治理框架

arXiv cs.LG 论文

摘要

本文提出 TRACE 治理框架,用于量化与追踪生产 AI 系统中的「可解释性债务」,并通过为期十二个月的欺诈检测案例研究展示其预测审计风险的能力,为欧盟 AI 法案第 13 条合规提供首个可量化运营架构。

arXiv:2610.10957v1 Announce Type: new Abstract: Production AI systems deployed in high-stakes domains accumulate a governance liability that existing monitoring frameworks fail to detect: the progressive inability to explain individual decisions when regulators, auditors, or affected individuals demand accountability. We introduce TRACE (Transparency, Risk, Accountability, Compliance, and Explainability), a seven-instrument governance framework for measuring, tracking, and remediating Explainability Debt in production AI systems. The foundational instrument, the Explainability Debt Score (EDS), quantifies the proportion of production decisions falling below a governance-defined explainability confidence threshold at any point in time. Complementary instruments include DART (Debt Accumulation Rate Tracker for breach forecasting), SHIV (Scenario Health and Integrity Validator for daily governance), FDE (Feature Drift Evaluator for causal attribution), HVE (Human Validation Engine), AIDE (Audit Intervention Decision Engine), and ZERO (Zero Explainability Risk Optimiser for remediation). Through a twelve-month longitudinal case study of a production fraud detection system processing 50,000 daily financial transactions, achieving 98.46% accuracy and ROC-AUC of 0.9990, we demonstrate that an EDS of 0.23 on audit day was statistically predictable six months in advance using DART trajectory analysis (beta = 0.008/week, R-squared = 0.94, 95% CI: [0.006, 0.010]), and that 78% of Explainability Debt was concentrated in the highest-regulatory-risk decision category (transactions above $10,000), a risk asymmetry completely invisible to system-level metrics. TRACE provides the first quantitative operational architecture for EU AI Act Article 13 compliance in production AI deployment, establishing a new subdiscipline of explanation governance distinct from explanation generation.
查看原文
查看缓存全文

缓存时间: 2026/10/09 06:44

# TRACE: A Governance Framework for Measuring Explainability Debt in Production AI Systems
Source: [https://arxiv.org/abs/2610.10957](https://arxiv.org/abs/2610.10957)
[View PDF](https://arxiv.org/pdf/2610.10957)

> Abstract:Production AI systems deployed in high\-stakes domains accumulate a governance liability that existing monitoring frameworks fail to detect: the progressive inability to explain individual decisions when regulators, auditors, or affected individuals demand accountability\. We introduce TRACE \(Transparency, Risk, Accountability, Compliance, and Explainability\), a seven\-instrument governance framework for measuring, tracking, and remediating Explainability Debt in production AI systems\. The foundational instrument, the Explainability Debt Score \(EDS\), quantifies the proportion of production decisions falling below a governance\-defined explainability confidence threshold at any point in time\. Complementary instruments include DART \(Debt Accumulation Rate Tracker for breach forecasting\), SHIV \(Scenario Health and Integrity Validator for daily governance\), FDE \(Feature Drift Evaluator for causal attribution\), HVE \(Human Validation Engine\), AIDE \(Audit Intervention Decision Engine\), and ZERO \(Zero Explainability Risk Optimiser for remediation\)\. Through a twelve\-month longitudinal case study of a production fraud detection system processing 50,000 daily financial transactions, achieving 98\.46% accuracy and ROC\-AUC of 0\.9990, we demonstrate that an EDS of 0\.23 on audit day was statistically predictable six months in advance using DART trajectory analysis \(beta = 0\.008/week, R\-squared = 0\.94, 95% CI: \[0\.006, 0\.010\]\), and that 78% of Explainability Debt was concentrated in the highest\-regulatory\-risk decision category \(transactions above $10,000\), a risk asymmetry completely invisible to system\-level metrics\. TRACE provides the first quantitative operational architecture for EU AI Act Article 13 compliance in production AI deployment, establishing a new subdiscipline of explanation governance distinct from explanation generation\.

## Submission history

From: Harish Pathak \[[view email](https://arxiv.org/show-email/7c8da388/2610.10957)\] **\[v1\]**Wed, 7 Oct 2026 22:19:36 UTC \(515 KB\)

相似文章

通过执行轨迹解释AI代理

arXiv cs.AI

本文介绍了一个事后可解释AI框架,该框架将AI代理执行轨迹转换为结构化报告和自然语言解释,以实现透明度和可审计性。