arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1403.6095stat.MEstat.ML
收藏

p>>N情形下典型向量的同时稀疏估计

Simultaneous sparse estimation of canonical vectors in the p>>N setting

Irina Gaynanova, James G. Booth, Martin T. Wells

摘要:

本文研究了线性判别分析中当采用$p\gg N$时典型向量的稀疏估计问题。在文献中已经提出了几种方法,估计一个典型的向量,在两组的情况下。然而,如果组的数目是$G$,则可以考虑$G-1$规范向量。在多组上下文中,通常以顺序方式估计典范向量。此外,通常需要对协方差结构进行单独的先验估计。我们提出了一种新的方法直接估计的典型向量。与现有技术相比,该方法一次估计所有典型向量,在所有向量上执行变量选择,并在变量选择和分类一致性上具有理论保证。首先,我们强调的事实是,在$N>p$设置的规范向量可以表示在一个封闭的形式,正交变换。其次,我们提出了这种形式的扩展到$p\gg N$设置,并通过使用组惩罚实现特征选择。由此产生的优化问题是凸的,可以使用块坐标下降算法来解决。该方法的实际性能进行了评估,通过模拟研究以及实际数据的应用。

英文摘要:

This article considers the problem of sparse estimation of canonical vectors in linear discriminant analysis when $p\gg N$. Several methods have been proposed in the literature that estimate one canonical vector in the two-group case. However, $G-1$ canonical vectors can be considered if the number of groups is $G$. In the multi-group context, it is common to estimate canonical vectors in a sequential fashion. Moreover, separate prior estimation of the covariance structure is often required. We propose a novel methodology for direct estimation of canonical vectors. In contrast to existing techniques, the proposed method estimates all canonical vectors at once, performs variable selection across all the vectors and comes with theoretical guarantees on the variable selection and classification consistency. First, we highlight the fact that in the $N>p$ setting the canonical vectors can be expressed in a closed form up to an orthogonal transformation. Secondly, we propose an extension of this form to the $p\gg N$ setting and achieve feature selection by using a group penalty. The resulting optimization problem is convex and can be solved using a block-coordinate descent algorithm. The practical performance of the method is evaluated through simulation studies as well as real data applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑