arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.02041stat.ME
收藏

结构自适应弹性网

Structure Adaptive Elastic-Net

Sandipan Pramanik, Xianyang Zhang

摘要:

惩罚线性回归在高维统计中具有根本的重要性,并且已常规地用于对高维预测因子集的响应进行回归。在许多科学应用中,存在编码预测器的预测能力和稀疏结构的外部信息。在这篇文章中,我们提出了结构自适应弹性网(SA-Enet),它提供了一个新的框架,将潜在有用的边信息纳入惩罚回归。其基本思想是将外部信息转化为回归系数的不同惩罚强度。我们特别关注组和协变量依赖的结构,并研究由此产生的估计的风险属性。为此,我们将最近引入的用于分析近似消息传递算法的状态演化框架推广到SA-Enet框架。我们表明,有限样本的SA-Enet估计的风险是一致的状态演化方程预测的理论风险。我们的理论表明,具有信息组或协变量结构的SA-Enet可以优于Lasso,Adaptive Lasso,Sparse Group Lasso,加权弹性网和Graper。这一证据在我们的数值研究中得到了进一步证实。我们还证明了我们的方法对来自分子生物学和精准医学的白血病数据的有用性和优越性。

英文摘要:

Penalized linear regression is of fundamental importance in high-dimensional statistics and has been routinely used to regress a response on a high-dimensional set of predictors. In many scientific applications, there exists external information that encodes the predictive power and sparsity structure of the predictors. In this article, we propose the Structure Adaptive Elastic-Net (SA-Enet), which provides a new framework for incorporating potentially useful side information into a penalized regression. The basic idea is to translate the external information into different penalization strengths for the regression coefficients. We particularly focus on group and covariate-dependent structures and study the risk properties of the resulting estimator. To this, we generalize the state evolution framework recently introduced for the analysis of the approximate message-passing algorithm to the SA-Enet framework. We show that the finite sample risk of the SA-Enet estimator is consistent with the theoretical risk predicted by the state evolution equation. Our theory suggests that the SA-Enet with an informative group or covariate structure can outperform the Lasso, Adaptive Lasso, Sparse Group Lasso, Feature-weighted Elastic-Net, and Graper. This evidence is further confirmed in our numerical studies. We also demonstrate the usefulness and the superiority of our method for leukemia data from molecular biology and precision medicine.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑