arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.09017stat.ME
收藏

B-CONCORD --一种可扩展的贝叶斯高维精度矩阵估计方法

B-CONCORD -- A scalable Bayesian high-dimensional precision matrix estimation procedure

Peyman Jalali, Kshitij Khare, George Michailidis

摘要:

高维尺度下精度矩阵的稀疏估计是统计学和机器学习中的一个典型问题。已经开发了许多基于回归和似然的方法,许多频率论和一些贝叶斯理论。贝叶斯方法通过后验分布提供模型参数的直接不确定性量化,因此不需要第二轮计算来获得模型参数的去偏估计及其置信区间。然而,对于涉及500多个变量的设置,它们在计算上是昂贵的。为此,我们为手头的问题开发了B-CONCORD,这是Khare等人(2015)引入的CONvex CORrelation选择方法(CONCORD)的贝叶斯模拟。B-CONCORD利用CONCORD广义似然函数以及尖峰和平板先验分布来诱导精度矩阵参数的稀疏性。我们建立了模型选择和估计的一致性在高维尺度下,进一步,我们开发了一个程序,只refits非零参数的精度矩阵,导致显着改善在有限样本的估计。大量的数值计算工作说明了所提出的方法相对于竞争贝叶斯方法的计算可扩展性,以及它的准确性。

英文摘要:

Sparse estimation of the precision matrix under high-dimensional scaling constitutes a canonical problem in statistics and machine learning. Numerous regression and likelihood based approaches, many frequentist and some Bayesian in nature have been developed. Bayesian methods provide direct uncertainty quantification of the model parameters through the posterior distribution and thus do not require a second round of computations for obtaining debiased estimates of the model parameters and their confidence intervals. However, they are computationally expensive for settings involving more than 500 variables. To that end, we develop B-CONCORD for the problem at hand, a Bayesian analogue of the CONvex CORrelation selection methoD (CONCORD) introduced by Khare et al. (2015). B-CONCORD leverages the CONCORD generalized likelihood function together with a spike-and-slab prior distribution to induce sparsity in the precision matrix parameters. We establish model selection and estimation consistency under high-dimensional scaling; further, we develop a procedure that refits only the non-zero parameters of the precision matrix, leading to significant improvements in the estimates in finite samples. Extensive numerical work illustrates the computational scalability of the proposed approach vis-a-vis competing Bayesian methods, as well as its accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑