arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.00488math.STmath.PRstat.TH
收藏

宽高比不同时低秩矩阵估计的基本极限

Fundamental Limits of Low-Rank Matrix Estimation with Diverging Aspect Ratios

Andrea Montanari, Yuchen Wu

摘要:

我们考虑的问题,估计的因素,低秩$n \times d$矩阵,当这是损坏的加性高斯噪声。一个特殊的例子,我们的设置对应于聚类混合高斯等(已知)协方差。简单的谱方法没有考虑这些因子的条目的分布,因此通常是次优的。在这里,我们在统计学家已知条目分布的假设下,描述了最小估计误差的渐进性。我们的结果适用于高维政权$n, d \to \infty$和$d / n \to \infty$(或$d / n \to 0$)和推广早期的工作,集中在比例渐近$n, d \to \infty$,$d / n \to δ\in (0, \infty)$。我们概述了一个有趣的信号强度制度,其中$d / n \to \infty$和部分恢复是可能的左奇异向量,而不可能的右奇异向量。我们说明了一般的理论推导高斯混合聚类的后果,并进行了数值研究的基因组数据。

英文摘要:

We consider the problem of estimating the factors of a low-rank $n \times d$ matrix, when this is corrupted by additive Gaussian noise. A special example of our setting corresponds to clustering mixtures of Gaussians with equal (known) covariances. Simple spectral methods do not take into account the distribution of the entries of these factors and are therefore often suboptimal. Here, we characterize the asymptotics of the minimum estimation error under the assumption that the distribution of the entries is known to the statistician. Our results apply to the high-dimensional regime $n, d \to \infty$ and $d / n \to \infty$ (or $d / n \to 0$) and generalize earlier work that focused on the proportional asymptotics $n, d \to \infty$, $d / n \to δ\in (0, \infty)$. We outline an interesting signal strength regime in which $d / n \to \infty$ and partial recovery is possible for the left singular vectors while impossible for the right singular vectors. We illustrate the general theory by deriving consequences for Gaussian mixture clustering and carrying out a numerical study on genomics data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑