arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01477stat.MLcs.LG

密度信息伪计数用于校准的神经证据深度学习

Density-Informed Pseudo-Counts for Calibrated Evidential Deep Learning

Department of Statistics and Data Sciences(统计与数据科学系)

Pietro Carlotti, Nevena Gligić, Arya Farahi

AI总结:

针对证据深度学习在分布外输入上过度自信的问题,提出密度信息伪计数EDL(DIP-EDL),通过分离条件标签分布和边际协变量密度来解耦认知不确定性和偶然不确定性,实现校准的不确定性估计。

摘要:

证据深度学习(EDL)是一种流行的不确定性感知分类框架,通过由神经网络参数化的狄利克雷分布对预测不确定性进行建模。尽管其流行,但其理论基础和在分布偏移下的行为仍知之甚少。在这项工作中,我们通过证明EDL训练对应于具有温度调整伪似然的层次贝叶斯模型中的摊销变分推断,提供了原则性的统计解释。这一视角揭示了一个主要缺点:标准EDL混淆了认知不确定性和偶然不确定性,导致在分布外(OOD)输入上系统性过度自信。为了解决这个问题,我们引入了密度信息伪计数EDL(DIP-EDL),这是一种新的参数化方法,通过分别估计条件标签分布和边际协变量密度,将类别预测与不确定性大小解耦。这种分离在高密度区域保留了证据,同时将OOD数据的预测向均匀先验收缩。理论上,我们证明了DIP-EDL实现了渐近集中。实验上,我们展示了我们的方法增强了可解释性,并提高了在分布偏移下的鲁棒性和不确定性校准。

英文摘要:

Evidential Deep Learning (EDL) is a popular framework for uncertainty-aware classification that models predictive uncertainty via Dirichlet distributions parameterized by neural networks. Despite its popularity, its theoretical foundations and behavior under distributional shift remain poorly understood. In this work, we provide a principled statistical interpretation by proving that EDL training corresponds to amortized variational inference in a hierarchical Bayesian model with a tempered pseudo-likelihood. This perspective reveals a major drawback: standard EDL conflates epistemic and aleatoric uncertainty, leading to systematic overconfidence on out-of-distribution (OOD) inputs. To address this, we introduce Density-Informed Pseudo-count EDL (DIP-EDL), a new parametrization that decouples class prediction from the magnitude of uncertainty by separately estimating the conditional label distribution and the marginal covariate density. This separation preserves evidence in high-density regions while shrinking predictions toward a uniform prior for OOD data. Theoretically, we prove that DIP-EDL achieves asymptotic concentration. Empirically, we show that our method enhances interpretability and improves robustness and uncertainty calibration under distributional shift.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑