arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1901.05229stat.ME
收藏

相关效应的平滑调整

Smooth Adjustment for Correlated Effects

Yuehan Yang, Hu Yang

摘要:

本文考虑了一个含校正变量的高维线性回归模型。近年来,各种方法已经发展起来,但它仍然是具有挑战性的,保持准确的估计时,有复杂的相关结构之间的预测和响应。我们提出了一个自适应的和“反向”的惩罚正则化来解决这个问题。这种惩罚并没有缩小变量,而是专注于消除收缩偏差并鼓励分组效应。结合l_1罚函数和最小最大凹罚函数(MCP),提出了相关效应平滑调整(SACE)和相关效应广义平滑调整(GSACE)两种方法。与传统的自适应估计器相比,所提出的方法受初始估计器的影响较小,可以减少初始估计的假阴性。所提出的方法可以被看作是新的惩罚的调整参数的线性函数,并示出在极高的相关变量的情况下和弱相关变量的情况下,准确地估计系数。在较弱的正则条件下,证明了该方法满足一定的预言性质.我们通过模拟和应用表明,所提出的方法往往优于其他方法。

英文摘要:

This paper considers a high dimensional linear regression model with corrected variables. A variety of methods have been developed in recent years, yet it is still challenging to keep accurate estimation when there are complex correlation structures among predictors and the response. We propose an adaptive and "reversed" penalty for regularization to solve this problem. This penalty doesn't shrink variables but focuses on removing the shrinkage bias and encouraging grouping effect. Combining the l_1 penalty and the Minimax Concave Penalty (MCP), we propose two methods called Smooth Adjustment for Correlated Effects (SACE) and Generalized Smooth Adjustment for Correlated Effects (GSACE). Compared with the traditional adaptive estimator, the proposed methods have less influence from the initial estimator and can reduce the false negatives of the initial estimation. The proposed methods can be seen as linear functions of the new penalty's tuning parameter, and are shown to estimate the coefficients accurately in both extremely highly correlated variables situation and weakly correlated variables situation. Under mild regularity conditions we prove that the methods satisfy certain oracle property. We show by simulations and applications that the proposed methods often outperforms other methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑