Deep neural networks have significantly contributed to the success in predictive accuracy for classification tasks. However, they tend to make over-confident predictions in real-world settings, where domain shifting and out-of-distribution (OOD) examples exist. Most research on uncertainty estimation focuses on computer vision because it provides visual validation on uncertainty quality. However, few have been presented in the natural language process domain. Unlike Bayesian methods that indirectly infer uncertainty through weight uncertainties, current evidential uncertainty-based methods explicitly model the uncertainty of class probabilities through subjective opinions. They further consider inherent uncertainty in data with different root causes, vacuity (i.e., uncertainty due to a lack of evidence) and dissonance (i.e., uncertainty due to conflicting evidence). In our paper, we firstly apply evidential uncertainty in OOD detection for text classification tasks. We propose an inexpensive framework that adopts both auxiliary outliers and pseudo off-manifold samples to train the model with prior knowledge of a certain class, which has high vacuity for OOD samples. Extensive empirical experiments demonstrate that our model based on evidential uncertainty outperforms other counterparts for detecting OOD examples. Our approach can be easily deployed to traditional recurrent neural networks and fine-tuned pre-trained transformers.
UAT-LITE: Inference-Time Uncertainty-Aware Attention for Pretrained Transformers
University of Central Florida(佛罗里达大学中央分校);University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校);Meharry Medical College(梅哈里医学院);University of Southern Queensland(昆士兰南方大学);New York University(纽约大学)
PPO-UE: Proximal Policy Optimization via Uncertainty-Aware Exploration
Virginia Tech(弗吉尼亚理工大学);University of Oslo(奥斯陆大学);DEVCOM Army Research Laboratory(DEVCOM陆军研究实验室);University of Texas at Dallas(德克萨斯大学达拉斯分校);University of the District of Columbia(哥伦比亚特区大学)
Pixel-global Self-supervised Learning with Uncertainty-aware Context Stabilizer
我们开发了一种新型的SSL方法来捕获相同图像的不同增强视图之间的全局一致性和像素级局部一致性,以适应下游的区分性和密集预测任务。我们采用了以前的对比SSL方法中使用的师生架构。在我们的方法中,通过聚合同一图像的增强视图的压缩表示来执行全局一致性。通过在不同增强视图中对相同像素进行相似表示来执行像素级一致性。重要的是,我们引入了一个不确定性感知的上下文稳定器,以自适应地保留由来自不同增强的两个视图所创建的上下文间隙。此外,我们在稳定器中使用Monte Carlo dropout来测量不确定性,并自适应地平衡不同视图中相同像素的表示之间的差异。
EviDep: Uncertainty-Aware Multimodal Depression Estimation via Disentangled Evidential Learning
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机科学与信息工程学院);Department of Psychiatry, The First Affiliated Hospital of University of Science and Technology of China, Division of Life Sciences and Medicine, University of Science and Technology of China(中国科学技术大学附属第一医院精神科,生命科学与医学学院)
Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention
Siemens AG(西门子公司);Goethe University Frankfurt(法兰克福歌德大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);German Cancer Research Center (DKFZ)(德国癌症研究中心);German Cancer Consortium (DKTK)(德国癌症联盟)
Challenge Summary U-MedSAM: Uncertainty-aware MedSAM for Medical Image Segmentation
University at Albany, State University of New York (SUNY)(纽约州立大学奥尔巴尼分校);College of Integrated Health Sciences and the AI Plus Institute, University at Albany, State University of New York (SUNY)(纽约州立大学奥尔巴尼分校整合健康科学学院及AI Plus研究所);School of Physics and Electronics, Shandong Normal University(山东师范大学物理与电子科学学院);School of Computing and Artificial Intelligence, Southwest Jiaotong University(西南交通大学计算机与人工智能学院);Purdue University(普渡大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
Proximity-Based Evidence Retrieval for Uncertainty-Aware Neural Networks
Faculty of Engineering & IT, University of Technology Sydney(悉尼技术大学工程与信息学院);University Research and Innovation Center (EKIK), Óbuda University(奥布达大学研究与创新中心)
Walking Through Uncertainty: An Empirical Study of Uncertainty Estimation for Audio-Aware Large Language Models
Graduate Institute of Communication Engineering, National Taiwan University, Taiwan(台湾大学通讯工程研究所);Artificial Intelligence Center of Research Excellence (AI-CoRE), National Taiwan University, Taiwan(台湾大学人工智能卓越研究中心)