arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.05557cs.LGcs.DSstat.ML
收藏

Learning Entangled Single-Sample Gaussians in the Subset-of-Signals Model

University of Wisconsin-Madison(威斯康星大学麦迪逊分校);University of Science and Technology of China(中国科学技术大学)

Yingyu Liang, Hui Yuan

英文摘要:

In the setting of entangled single-sample distributions, the goal is to estimate some common parameter shared by a family of $n$ distributions, given one single sample from each distribution. This paper studies mean estimation for entangled single-sample Gaussians that have a common mean but different unknown variances. We propose the subset-of-signals model where an unknown subset of $m$ variances are bounded by 1 while there are no assumptions on the other variances. In this model, we analyze a simple and natural method based on iteratively averaging the truncated samples, and show that the method achieves error $O \left(\frac{\sqrt{n\ln n}}{m}\right)$ with high probability when $m=Ω(\sqrt{n\ln n})$, matching existing bounds for this range of $m$. We further prove lower bounds, showing that the error is $Ω\left(\left(\frac{n}{m^4}\right)^{1/2}\right)$ when $m$ is between $Ω(\ln n)$ and $O(n^{1/4})$, and the error is $Ω\left(\left(\frac{n}{m^4}\right)^{1/6}\right)$ when $m$ is between $Ω(n^{1/4})$ and $O(n^{1 - ε})$ for an arbitrarily small $ε>0$, improving existing lower bounds and extending to a wider range of $m$.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑