arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.24170cs.AI

可信概念瓶颈模型用于知识-随机不确定性分解

Credal Concept Bottleneck Models for Epistemic-Aleatoric Uncertainty Decomposition

Univ. Artois, CNRS, CRIL, France(阿维尼昂大学,法国国家科学研究中心,CRIL,法国)

Tanmoy Mukherjee, Thomas Bailleux, Pierre Marquis, Zied Bouraoui

AI总结:

本文提出CREDENCE模型,通过分解概念不确定性提升不确定性解释与决策能力,展示知识不确定性与预测误差正相关,随机不确定性与标注分歧紧密相关。

摘要:

概念瓶颈模型(CBMs)通过人类可解释的概念进行预测,但通常输出点概念概率,将知识不确定性(可减少的模型不充分)与随机不确定性(不可减少的输入模糊)混淆。为此,本文引入CREDENCE(可信集合概念估计)框架,通过构造分解概念不确定性。CREDENCE将每个概念表示为可信预测(概率区间),从不同概念头的分歧中推导知识不确定性,并通过专用模糊输出估计随机不确定性。所获信号支持决策:自动化低不确定性案例,优先收集高知识案例数据,将高随机案例路由至人类审查,并在两者均高时 abstain。在多个任务中,展示知识不确定性与预测误差正相关,而随机不确定性紧密跟踪标注分歧,提供超越误差相关性的指导。实现代码见:https://github.com/Tankiit/Credal_Sets/tree/ensemble-credal-cbm

英文摘要:

Concept Bottleneck Models (CBMs) predict through human-interpretable concepts, but they typically output point concept probabilities that conflate epistemic uncertainty (reducible model underspecification) with aleatoric uncertainty (irreducible input ambiguity). This makes concept-level uncertainty hard to interpret and, more importantly, hard to act upon. We introduce CREDENCE (Credal Ensemble Concept Estimation), a CBM framework that decomposes concept uncertainty by construction. CREDENCE represents each concept as a credal prediction (a probability interval), derives epistemic uncertainty from disagreement across diverse concept heads, and estimates aleatoric uncertainty via a dedicated ambiguity output trained to match annotator disagreement when available. The resulting signals support prescriptive decisions: automate low-uncertainty cases, prioritize data collection for high-epistemic cases, route high-aleatoric cases to human review, and abstain when both are high. Across several tasks, we show that epistemic uncertainty is positively associated with prediction errors, whereas aleatoric uncertainty closely tracks annotator disagreement, providing guidance beyond error correlation. Our implementation is available at the following link: https://github.com/Tankiit/Credal_Sets/tree/ensemble-credal-cbm

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑