arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.14913math.STstat.TH
收藏

基于最大均值差异的高维两样本检验

Two Sample Testing in High Dimension via Maximum Mean Discrepancy

Hanjia Gao, Xiaofeng Shao

AI总结:

该研究针对高维场景下的两样本检验问题,推导了高维下学生化样本MMD的中心极限定理与收敛速率,提出适配中高维数据的MMD检验方法并通过模拟验证了其有效性。

摘要:

最大均值差异(Maximum Mean Discrepancy, MMD)已在机器学习与统计学领域被广泛用于量化p维欧氏空间中两个分布之间的距离。当维度p固定时,已有研究借助U统计量理论充分探究了样本MMD的渐近性质。受中高维数据中MMD检验的广泛应用启发,我们提出研究高维环境下样本MMD的行为,并构建一种新的学生化检验统计量。具体而言,我们推导了当维度p与样本量n、m均趋于无穷时,学生化样本MMD的中心极限定理。我们的结果适用于多种核函数,包括常用的高斯核与拉普拉斯核,也将能量距离作为特例涵盖其中。我们还在温和假设下推导了显式收敛速率,结果表明正态近似的精度会随维度升高而提升。此外,我们给出了备择假设下功效分析的通用理论,证明所提检验能够在中高维情形下检测两个分布之间的差异。数值模拟验证了我们提出的检验统计量与正态近似的有效性。

英文摘要:

Maximum Mean Discrepancy (MMD) has been widely used in the areas of machine learning and statistics to quantify the distance between two distributions in the $p$-dimensional Euclidean space. The asymptotic property of the sample MMD has been well studied when the dimension $p$ is fixed using the theory of U-statistic. As motivated by the frequent use of MMD test for data of moderate/high dimension, we propose to investigate the behavior of the sample MMD in a high-dimensional environment and develop a new studentized test statistic. Specifically, we obtain the central limit theorems for the studentized sample MMD as both the dimension $p$ and sample sizes $n,m$ diverge to infinity. Our results hold for a wide range of kernels, including popular Gaussian and Laplacian kernels, and also cover energy distance as a special case. We also derive the explicit rate of convergence under mild assumptions and our results suggest that the accuracy of normal approximation can improve with dimensionality. Additionally, we provide a general theory on the power analysis under the alternative hypothesis and show that our proposed test can detect difference between two distributions in the moderately high dimensional regime. Numerical simulations demonstrate the effectiveness of our proposed test statistic and normal approximation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑