arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1810.04651stat.MEstat.ML
收藏

主成分引导稀疏回归

Principal component-guided sparse regression

J. Kenneth Tay, Jerome Friedman, Robert Tibshirani

摘要:

我们提出了一种新的监督学习方法,特别适合于特征数量远远大于观测数量的宽数据。该方法结合了套索($\ell_1$)稀疏惩罚与二次惩罚,缩小系数向量的特征矩阵的领先的主成分。我们称所提出的方法为“主成分套索”(“pcLasso”)。如果特征被预先分配到组(例如细胞通路、测定或蛋白质相互作用网络),则该方法可以特别强大。在这种情况下,pcLasso会将解的每个分组分量缩小到该组的领先主分量。在此过程中,还进行了特征组的选择。我们提供了一些理论,这种方法,并说明它的一些模拟和真实数据的例子。

英文摘要:

We propose a new method for supervised learning, especially suited to wide data where the number of features is much greater than the number of observations. The method combines the lasso ($\ell_1$) sparsity penalty with a quadratic penalty that shrinks the coefficient vector toward the leading principal components of the feature matrix. We call the proposed method the "principal components lasso" ("pcLasso"). The method can be especially powerful if the features are pre-assigned to groups (such as cell-pathways, assays or protein interaction networks). In that case, pcLasso shrinks each group-wise component of the solution toward the leading principal components of that group. In the process, it also carries out selection of the feature groups. We provide some theory for this method and illustrate it on a number of simulated and real data examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑