arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.09428stat.MEstat.AP
收藏

用于同步变量选择、降维与张量去噪的稀疏高阶偏最小二乘方法

Sparse higher order partial least squares for simultaneous variable selection, dimension reduction, and tensor denoising

Kwangmoon Park, Sündüz Keleş

AI总结:

针对高维张量场景下高阶偏最小二乘估计一致性无法保证的问题,提出可同步实现变量选择、降维与张量去噪的SHOPS回归方法,补全相关理论性质并通过实验与生物数据应用验证有效性。

摘要:

偏最小二乘(PLS)回归作为普通最小二乘的替代方法,被用于解决众多科学应用中的多重共线性问题。随着多维张量数据日益普及,学界已开发出PLS的张量适配版本。本文首先明确了Zhao等人(2012)提出的高阶偏最小二乘(HOPLS)的统计特性,证明当张量维度和特征数量的增长速度快于样本量时,HOPLS估计量的一致性无法得到保证。为解决该问题,我们提出稀疏高阶偏最小二乘(SHOPS)回归及配套算法,SHOPS可同步实现变量选择、降维和张量响应去噪。我们进一步推导了高维场景下SHOPS算法的渐近结果,这些结果也补全了SPLS算法(Chun和Keleş,2010)未知的理论性质。我们通过全面的模拟实验以及在一项新兴高维生物数据分析中的应用,验证了上述研究结论。

英文摘要:

Partial Least Squares (PLS) regression emerged as an alternative to ordinary least squares for addressing multicollinearity in a wide range of scientific applications. As multidimensional tensor data is becoming more widespread, tensor adaptations of PLS have been developed. In this paper, we first establish the statistical behavior of Higher Order PLS (HOPLS) of Zhao et al. (2012), by showing that the consistency of the HOPLS estimator cannot be guaranteed as the tensor dimensions and the number of features increase faster than the sample size. To tackle this issue, we propose Sparse Higher Order Partial Least Squares (SHOPS) regression and an accompanying algorithm. SHOPS simultaneously accommodates variable selection, dimension reduction, and tensor response denoising. We further establish the asymptotic results of the SHOPS algorithm under a high-dimensional regime. The results also complete the unknown theoretic properties of SPLS algorithm (Chun and Keleş, 2010). We verify these findings through comprehensive simulation experiments, and application to an emerging high-dimensional biological data analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑