We develop a simple and unified framework for nonlinear variable selection that incorporates uncertainty in the prediction function and is compatible with a wide range of machine learning models (e.g., tree ensembles, kernel methods, neural networks, etc). In particular, for a learned nonlinear model $f(\mathbf{x})$, we consider quantifying the importance of an input variable $\mathbf{x}^j$ using the integrated partial derivative $Ψ_j = \Vert \frac{\partial}{\partial \mathbf{x}^j} f(\mathbf{x})\Vert^2_{P_\mathcal{X}}$. We then (1) provide a principled approach for quantifying variable selection uncertainty by deriving its posterior distribution, and (2) show that the approach is generalizable even to non-differentiable models such as tree ensembles. Rigorous Bayesian nonparametric theorems are derived to guarantee the posterior consistency and asymptotic uncertainty of the proposed approach. Extensive simulations and experiments on healthcare benchmark datasets confirm that the proposed algorithm outperforms existing classic and recent variable selection methods.
Walking Through Uncertainty: An Empirical Study of Uncertainty Estimation for Audio-Aware Large Language Models
Graduate Institute of Communication Engineering, National Taiwan University, Taiwan(台湾大学通讯工程研究所);Artificial Intelligence Center of Research Excellence (AI-CoRE), National Taiwan University, Taiwan(台湾大学人工智能卓越研究中心)
Certainty in Uncertainty: Reasoning over Uncertain Knowledge Graphs with Statistical Guarantees
University of Stuttgart(斯图加特大学);Bosch Center for AI(博世人工智能中心);The University of Manchester(曼彻斯特大学);University of Oslo(奥斯陆大学);University of Southampton(南安普顿大学)
Uncertainty-Aware Time-to-Event Prediction using Deep Kernel Accelerated Failure Time Models
Ludwig Maximilians University Munich(慕尼黑路德维希-马克西米利安大学);Siemens AG(西门子股份公司);University Hospital Erlangen(埃尔朗根大学医院)
基于递归神经网络的解决方案越来越多地用于纵向电子健康记录数据的分析。然而,大多数工作都集中在预测准确性上,而忽视了预测的不确定性。我们提出了用于时间到事件预测任务的深度内核加速故障时间模型,通过递归神经网络和稀疏高斯过程的管道实现预测的不确定性意识。此外,基于深度度量学习的预训练步骤适于增强所提出的模型。在两个真实数据集上的实验中,我们的模型显示出比基于递归神经网络的基线更好的点估计性能。更重要的是,我们模型的预测方差可用于量化事件发生时间预测的不确定性估计:当我们的模型对其预测更有信心时,它会提供更好的性能。与相关方法(如Monte Carlo Dropout)相比,我们的模型通过利用分析解决方案提供了更好的不确定性估计,并且计算效率更高。
Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention
Siemens AG(西门子公司);Goethe University Frankfurt(法兰克福歌德大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);German Cancer Research Center (DKFZ)(德国癌症研究中心);German Cancer Consortium (DKTK)(德国癌症联盟)