arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1806.02138stat.ME
收藏

基于图的两样本检验的高维修正

On high-dimensional modifications of some graph-based two-sample tests

Soham Sarkar, Rahul Biswas, Anil K. Ghosh

摘要:

检验两个高维分布的相等性是一个具有挑战性的问题,当样本量很小时,这变得更具挑战性。在过去的几十年里,文献中提出了几种基于图的双样本检验,它们可以用于任意维数的数据。大多数这些检验统计量是使用观测值之间的成对欧几里得距离计算的。但是,由于集中的两两欧几里德距离,这些测试在许多高维问题的性能较差。当两个分布之间的尺度差异主导位置差异时,其中一些可以具有甚至低于标称水平的功率。为了克服这些限制,我们引入了一类新的相异性指数,并使用它来修改一些流行的基于图的测试。这些改进的测试利用了距离集中现象的优势,因此,它们在各种各样的示例中优于基于欧几里得距离的相应测试。我们在相当一般的条件下建立了这些修改后的测试的高维一致性。分析几个模拟以及真实的数据集,我们证明了他们的有用性,在高维,低样本量的情况下。

英文摘要:

Testing for the equality of two high-dimensional distributions is a challenging problem, and this becomes even more challenging when the sample size is small. Over the last few decades, several graph-based two-sample tests have been proposed in the literature, which can be used for data of arbitrary dimensions. Most of these test statistics are computed using pairwise Euclidean distances among the observations. But, due to concentration of pairwise Euclidean distances, these tests have poor performance in many high-dimensional problems. Some of them can have powers even below the nominal level when the scale-difference between two distributions dominates the location-difference. To overcome these limitations, we introduce a new class of dissimilarity indices and use it to modify some popular graph-based tests. These modified tests use the distance concentration phenomenon to their advantage, and as a result, they outperform the corresponding tests based on the Euclidean distance in a wide variety of examples. We establish the high-dimensional consistency of these modified tests under fairly general conditions. Analyzing several simulated as well as real data sets, we demonstrate their usefulness in high dimension, low sample size situations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑