arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.07773stat.MEmath.STstat.MLstat.TH
收藏

高维张量的联合建模与聚类

Jointly Modeling and Clustering Tensors in High Dimensions

Biao Cai, Jingfei Zhang, Will Wei Sun

AI总结:

本文提出一种高维张量混合模型及HECM算法,利用低秩均值和可分离协方差进行降维,并证明其几何收敛性,在实验中取得优于基准方法的聚类精度。

摘要:

我们通过引入一个具有异质协方差的高维张量混合模型,来研究张量总体的联合建模与聚类问题。为了有效应对张量对象的高维性,我们采用了合理的降维假设,这些假设利用了张量的内在结构,例如均值中的低秩性和协方差中的可分离性。在估计方面,我们开发了一种高效的高维期望条件最大化(HECM)算法,该算法将M步中难以处理的优化问题分解为一系列简单得多的条件优化问题,其中每个问题都是凸的、允许正则化,并且具有闭式更新公式。我们的理论分析面临双重挑战:一是EM型估计中的非凸性,二是在M步中只能获得条件最大化的解,由此引出“双重非凸性”的概念。我们证明,所提出的HECM算法在适当的初始化下,能以几何速度收敛到真实参数统计精度范围内的邻域。通过对比数值实验以及在一项医学研究中的应用,我们验证了所提方法的有效性,在该应用中,我们的方法相比现有基准方法取得了更高的聚类精度。

英文摘要:

We consider the problem of jointly modeling and clustering populations of tensors by introducing a high-dimensional tensor mixture model with heterogeneous covariances. To effectively tackle the high dimensionality of tensor objects, we employ plausible dimension reduction assumptions that exploit the intrinsic structures of tensors such as low-rankness in the mean and separability in the covariance. In estimation, we develop an efficient high-dimensional expectation-conditional-maximization (HECM) algorithm that breaks the intractable optimization in the M-step into a sequence of much simpler conditional optimization problems, each of which is convex, admits regularization and has closed-form updating formulas. Our theoretical analysis is challenged by both the non-convexity in the EM-type estimation and having access to only the solutions of conditional maximizations in the M-step, leading to the notion of dual non-convexity. We demonstrate that the proposed HECM algorithm, with an appropriate initialization, converges geometrically to a neighborhood that is within statistical precision of the true parameter. The efficacy of our proposed method is demonstrated through comparative numerical experiments and an application to a medical study, where our proposal achieves an improved clustering accuracy over existing benchmarking methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑