arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.14397stat.ME
收藏

具有CP低秩判别结构的高维张量分类

High-Dimensional Tensor Classification with CP Low-Rank Discriminant Structure

Elynn Chen, Yuefeng Han, Jiayu Li

AI总结:

针对高维张量分类挑战,提出基于线性判别分析并利用CP低秩结构的框架,结合随机复合PCA初始化与迭代投影算法,在互相关噪声下实现全局收敛,并证明了极小化极大最优误分类率。

摘要:

张量分类在统计学和机器学习中变得日益重要,其应用涵盖神经影像、计算机视觉和推荐系统。然而,张量的高维性在理论和实践上都提出了重大挑战。为了应对这些挑战,我们引入了一种基于线性判别分析(LDA)的新型数据驱动分类框架,该框架利用了判别张量中的CP低秩结构。我们的方法包括一种用于张量LDA的先进迭代投影算法,并引入了一种名为随机复合PCA(\ extsc{rc-PCA})的新型初始化方案。\ extsc{rc-PCA}在张量分类之外可能具有独立的研究价值,它放宽了现有算法的非相干性和特征值比率假设,并提供了接近全局最优的暖启动。我们利用\ extsc{rc-PCA}为张量估计算法建立了全局收敛保证,并针对具有互相关性的噪声开发了新的扰动分析,超越了传统的独立同分布(i.i.d.)假设。这一理论进展在处理相关数据的各个领域具有潜在应用,并使我们能够推导出张量估计误差的统计上界。此外,我们通过在广泛的参数空间类中建立极小化极大最优误分类率,证实了分类器的速率最优性。大量的模拟和实际应用验证了我们方法的优越性能。

英文摘要:

Tensor classification has become increasingly crucial in statistics and machine learning, with applications spanning neuroimaging, computer vision, and recommendation systems. However, the high dimensionality of tensors presents significant challenges in both theory and practice. To address these challenges, we introduce a novel data-driven classification framework based on linear discriminant analysis (LDA) that exploits the CP low-rank structure in the discriminant tensor. Our approach includes an advanced iterative projection algorithm for tensor LDA and incorporates a novel initialization scheme called Randomized Composite PCA (\textsc{rc-PCA}). \textsc{rc-PCA}, potentially of independent interest beyond tensor classification, relaxes the incoherence and eigen-ratio assumptions of existing algorithms and provides a warm start close to the global optimum. We establish global convergence guarantees for the tensor estimation algorithm using \textsc{rc-PCA} and develop new perturbation analyses for noise with cross-correlation, extending beyond the traditional i.i.d. assumption. This theoretical advancement has potential applications across various fields dealing with correlated data and allows us to derive statistical upper bounds on tensor estimation errors. Additionally, we confirm the rate-optimality of our classifier by establishing minimax optimal misclassification rates across a wide class of parameter spaces. Extensive simulations and real-world applications validate our method's superior performance. Keywords: Tensor classification; Linear discriminant analysis; Tensor iterative projection; CP low-rank; High-dimensional data; Minimax optimality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑