arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.04851stat.ME
收藏

基于邻近映射的贝叶斯推断:变概率下的不确定性量化

Bayesian Inference using the Proximal Mapping: Uncertainty Quantification under Varying Dimensionality

Maoran Xu, Hua Zhou, Yujie Hu, Leo L. Duan

摘要:

在统计应用中,经常会遇到在变化或未知维空间上支持的参数。示例包括融合套索回归,未知低秩下的矩阵恢复等。尽管通过优化容易获得点估计,但量化其不确定性更具挑战性-在贝叶斯框架中,主要困难是如果分配与$p$维度量相关的先验,则在具有维度$d<p$的任何较低维度子集上存在零后验概率;为了避免这个警告,需要在$d$上选择另一个维度选择先验,这通常涉及高度组合的问题。为了显着减少建模负担,我们提出了一个新的生成过程的先验:从一个连续随机变量,如多元高斯,我们将其转换到一个变维空间使用邻近映射。这导致了一大类新的贝叶斯模型,可以直接利用流行的频率论正则化及其算法,如核范数惩罚和交替方向乘法,同时提供原则性和概率性的不确定性估计。我们表明,这个框架是合理的几何测度理论,并享有一个方便的后验计算通过标准的哈密顿蒙特卡罗。我们证明了它的使用中的动态流网络数据的分析。

英文摘要:

In statistical applications, it is common to encounter parameters supported on a varying or unknown dimensional space. Examples include the fused lasso regression, the matrix recovery under an unknown low rank, etc. Despite the ease of obtaining a point estimate via the optimization, it is much more challenging to quantify their uncertainty -- in the Bayesian framework, a major difficulty is that if assigning the prior associated with a $p$-dimensional measure, then there is zero posterior probability on any lower-dimensional subset with dimension $d<p$; to avoid this caveat, one needs to choose another dimension-selection prior on $d$, which often involves a highly combinatorial problem. To significantly reduce the modeling burden, we propose a new generative process for the prior: starting from a continuous random variable such as multivariate Gaussian, we transform it into a varying-dimensional space using the proximal mapping. This leads to a large class of new Bayesian models that can directly exploit the popular frequentist regularizations and their algorithms, such as the nuclear norm penalty and the alternating direction method of multipliers, while providing a principled and probabilistic uncertainty estimation. We show that this framework is well justified in the geometric measure theory, and enjoys a convenient posterior computation via the standard Hamiltonian Monte Carlo. We demonstrate its use in the analysis of the dynamic flow network data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑