arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.05656hep-excs.LG
收藏

用于深度神经网络喷注识别中不确定性量化与分布外检测的证据深度学习

Evidential Deep Learning for Uncertainty Quantification and Out-of-Distribution Detection in Jet Identification using Deep Neural Networks

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);The Grainger College of Engineering(格兰杰工程学院);Center for Artificial Intelligence Innovation(人工智能创新中心);National Center for Supercomputing Applications(国家超级计算应用中心);Siebel School of Computing and Data Science(西贝尔计算与数据科学学院)

Ayush Khot, Xiwei Wang, Avik Roy, Volodymyr Kindratenko, Mark S. Neubauer

AI总结:

本文面向LHC喷注识别研究EDL不确定性量化与分布外检测,通过超参数优化、类别不确定性、贝叶斯集成对比及潜在空间分析,提出更有效的EDL不确定性量化方法。

摘要:

当前常用于深度学习(DL)模型不确定性量化(UQ)的方法采用贝叶斯方法,计算成本高且耗时。本文针对旨在识别大型强子对撞机高能质子-质子碰撞中喷注的深度神经网络模型,详细研究了基于证据深度学习(EDL)的UQ,并探索其在异常检测中的效用。EDL是一种将学习视为证据获取过程的DL方法,旨在提供关于测试数据的置信度(或认知不确定性)。利用用于喷注分类基准测试的公开数据集,我们探索了将EDL应用于喷注识别UQ挑战时的超参数优化。我们还研究了每个喷注类别的不确定性如何分布、如何实施该方法以检测异常、该不确定性与贝叶斯集成方法相比如何,以及不确定性如何映射到模型的潜在空间。研究揭示了EDL应用于异常检测时的一些陷阱,并发现与基础EDL设置相比,一种从EDL量化不确定性的更有效方式。这些研究阐明了一种解释喷注分类模型中EDL的方法论,为EDL如何量化不确定性并检测分布外数据提供了新见解,这可能推动面向分类任务的DL模型改进EDL方法。

英文摘要:

Current methods commonly used for uncertainty quantification (UQ) in deep learning (DL) models utilize Bayesian methods which are computationally expensive and time-consuming. In this paper, we provide a detailed study of UQ based on evidential deep learning (EDL) for deep neural network models designed to identify jets in high energy proton-proton collisions at the Large Hadron Collider and explore its utility in anomaly detection. EDL is a DL approach that treats learning as an evidence acquisition process designed to provide confidence (or epistemic uncertainty) about test data. Using publicly available datasets for jet classification benchmarking, we explore hyperparameter optimizations for EDL applied to the challenge of UQ for jet identification. We also investigate how the uncertainty is distributed for each jet class, how this method can be implemented for the detection of anomalies, how the uncertainty compares with Bayesian ensemble methods, and how the uncertainty maps onto latent spaces for the models. Our studies uncover some pitfalls of EDL applied to anomaly detection and a more effective way to quantify uncertainty from EDL as compared with the foundational EDL setup. These studies illustrate a methodological approach to interpreting EDL in jet classification models, providing new insights on how EDL quantifies uncertainty and detects out-of-distribution data which may lead to improved EDL methods for DL models applied to classification tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑