无标签的治理证据退化检测在风险决策系统中
Label-Free Detection of Governance Evidence Degradation in Risk Decision Systems
AI总结:
本文提出无标签的治理监控方法,通过复合多代理监控评估治理证据,实验证明其在风险决策系统中有效检测退化并支持渐进式治理响应。
摘要:
欺诈检测和信用评分中的风险决策系统在结构上缺乏标签:真实标签在决策后数周至数月才出现。在此盲期内,模型性能可能逐渐退化,削弱自动决策的治理证据。现有漂移检测方法要么需要标签(监督检测器)要么无法区分有害退化与良性分布变化(无监督检测器)。本文提出无标签的治理监控扩展,通过复合多代理监控(分数分布、特征漂移、预测熵、置信度分布)生成治理警报而非统计警报。在Lending Club信用评分数据集(137万笔贷款,11年)上的实验证明,复合分数在更多监控器触发时提供单调严重性进展,支持渐进式治理响应。跨领域比较显示检测/未检测边界在两个领域一致。工具包和评估代码作为开源 artifacts 提供。
英文摘要:
Risk decision systems in fraud detection and credit scoring operate under structural label absence: ground truth arrives weeks to months after decisions are made. During this blind period, model performance may degrade silently, eroding the governance evidence that justifies automated decisions. Existing drift detection methods either require labels (supervised detectors) or detect statistical change without distinguishing harmful degradation from benign distributional evolution (unsupervised detectors). No existing framework integrates drift detection with governance evidence assessment and operational response. This paper presents a label-free governance monitoring extension to the Governance Drift Toolkit that produces governance alerts rather than statistical alarms. The monitoring architecture applies composite multi-proxy monitoring across four proxy monitors (score distribution, feature drift, prediction entropy, confidence distribution), with governance-calibrated thresholds. Empirical evaluation on the Lending Club credit scoring dataset (1.37M loans, 11 years) demonstrates three findings. First, raw proxy metrics (Feature PSI delta up to 1.84, Score PSI delta up to 0.92) distinguish injected covariate degradation from natural temporal drift in an offline evaluation setting. Second, pure concept drift in P(Y|X) produces exactly zero delta across all proxy metrics in all windows, confirming the irreducible blind spot of label-free monitoring as a structural verification. Third, the composite score provides monotonic severity progression as more monitors trigger (0.583 to 0.833 to 1.000), enabling graduated governance response. Cross-domain comparison with IEEE-CIS fraud detection results shows the detectable/undetectable boundary is consistent across both domains. The toolkit and evaluation code are available as open-source artifacts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。