arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0908.1836math.STstat.TH
收藏

关于参数个数发散的自适应弹性网

On the adaptive elastic-net with a diverging number of parameters

Hui Zou, Hao Helen Zhang

摘要:

我们考虑的问题的模型选择和估计的情况下,参数的数量与样本量发散。当维数较高时,理想的方法应该具有预言性质[J. Amer. Statistic. Assoc.96(2001)1348- 1360]和[Ann. Statist. 32(2004)928- 961],这确保了最佳的大样本性能。此外,高维数往往会导致共线性问题,这应该由理想方法妥善处理。许多现有的变量选择方法不能同时实现这两个目标。在本文中,我们提出了自适应弹性网络,结合了二次正则化和自适应加权套索收缩的优势。在弱正则性条件下,建立了自适应弹性网的预言性质。我们通过仿真表明,自适应弹性网络处理共线性问题比其他的预言机类方法,从而享有更好的有限样本性能。

英文摘要:

We consider the problem of model selection and estimation in situations where the number of parameters diverges with the sample size. When the dimension is high, an ideal method should have the oracle property [J. Amer. Statist. Assoc. 96 (2001) 1348--1360] and [Ann. Statist. 32 (2004) 928--961] which ensures the optimal large sample performance. Furthermore, the high-dimensionality often induces the collinearity problem, which should be properly handled by the ideal method. Many existing variable selection methods fail to achieve both goals simultaneously. In this paper, we propose the adaptive elastic-net that combines the strengths of the quadratic regularization and the adaptively weighted lasso shrinkage. Under weak regularity conditions, we establish the oracle property of the adaptive elastic-net. We show by simulations that the adaptive elastic-net deals with the collinearity problem better than the other oracle-like methods, thus enjoying much improved finite sample performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑