arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.04715math.STstat.TH
收藏

高维场景下基于全局-局部先验的一致性分组选择

Consistent Group selection using Global-local prior in High dimensional setup

Sayantan Paul, Prasenjit Ghosh, Arijit Chakrabarti

AI总结:

针对高维场景下带固有分组结构的回归变量模型选择问题,本文提出带多项式尾部的改进全局-局部收缩先验及半阈值分组选择规则,证明其理论性质并通过仿真验证可达到与尖峰-平板先验相近的效果。

摘要:

本文研究回归变量存在固有分组结构时的模型选择问题。我们采用贝叶斯方法,通过属于包含马蹄(horseshoe)先验在内的一大类单组全局-局部收缩先验对均值向量建模,这类先验此前已由Tang等人(2018)在变量选择场景下开展研究。本文针对分组回归系数提出了常规全局-局部收缩先验类的一种改进形式,该形式具备多项式尾部特性。基于该先验推导得到的阈值规则为:若某一分组内,其分组系数后验均值的L2范数与对应普通最小二乘分组估计的L2范数之比大于1/2,则判定该分组为活跃分组。在理论部分,我们根据模型潜在稀疏性的已知情况,将全局收缩参数τ作为调优参数或采用其经验贝叶斯估计:当活跃分组占比已知时,将τ作为调优参数,我们证明了所提方法具备神谕(oracle)性质;当该占比未知时,我们提出了τ的经验贝叶斯估计,即便使用该经验贝叶斯估计,我们的半阈值规则仍能准确识别真正重要的分组,同时可获得分组系数的最优估计速率。尽管我们的理论推导依赖特定形式的设计矩阵,但仿真结果表明,对于通用设计矩阵,该半阈值规则的表现与Yang和Narisetty(2020)提出的方法相近。这一结果意味着,在高维稀疏分组选择问题中,无需使用所谓“黄金标准”的尖峰-平板(spike and slab)先验,采用具备多项式尾部的单组全局-局部收缩先验即可获得相近效果。

英文摘要:

We consider the problem of model selection when grouping structure is inherent within the regressors. Using a Bayesian approach, we model the mean vector by a one-group global-local shrinkage prior belonging to a broad class of such priors that includes the horseshoe prior. In the context of variable selection, this class of priors was studied by Tang et al. (2018). A modified form of the usual class of global-local shrinkage priors with polynomial tail on the group regression coefficients is proposed. The resulting threshold rule selects the active group if within a group, the ratio of the $L_2$ norm of the posterior mean of its group coefficient to that of the corresponding ordinary least square group estimate is greater than a half. In the theoretical part of this article, we have used the global shrinkage parameter either as a tuning one or an empirical Bayes estimate of it depending on the knowledge regarding the underlying sparsity of the model. When the proportion of active groups is known, using $τ$ as a tuning parameter, we have proved that our method is oracle. In case this proportion is unknown, we propose an empirical Bayes estimate of $τ$. Even if this empirical Bayes estimate is used, then also our half-thresholding rule captures the truly important groups and obtains optimal estimation rate of the group coefficients simultaneously. Though our theoretical works rely on a special form of the design matrix, for general design matrices also, our simulation results show that the half-thresholding rule yields results similar to that of Yang and Narisetty (2020). As a consequence of this, in a high dimensional sparse group selection problem, instead of using the so-called `gold standard' spike and slab prior, one can use the one-group global-local shrinkage priors with polynomial tail to obtain similar results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑