arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.09960stat.MLcs.LGmath.OCmath.STstat.MEstat.TH

Efficient Clustering for Stretched Mixtures: Landscape and Optimality

Columbia University(哥伦比亚大学);Princeton University(普林斯顿大学);Cornell University(康奈尔大学)

Kaizheng Wang, Yuling Yan, Mateo Díaz

英文摘要:

This paper considers a canonical clustering problem where one receives unlabeled samples drawn from a balanced mixture of two elliptical distributions and aims for a classifier to estimate the labels. Many popular methods including PCA and k-means require individual components of the mixture to be somewhat spherical, and perform poorly when they are stretched. To overcome this issue, we propose a non-convex program seeking for an affine transform to turn the data into a one-dimensional point cloud concentrating around $-1$ and $1$, after which clustering becomes easy. Our theoretical contributions are two-fold: (1) we show that the non-convex loss function exhibits desirable geometric properties when the sample size exceeds some constant multiple of the dimension, and (2) we leverage this to prove that an efficient first-order algorithm achieves near-optimal statistical precision without good initialization. We also propose a general methodology for clustering with flexible choices of feature transforms and loss objectives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑