arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1506.04725stat.ML
收藏

基于概率测度解析表示的快速双样本检验

Fast Two-Sample Testing with Analytic Representations of Probability Measures

Kacper Chwialkowski, Aaditya Ramdas, Dino Sejdinovic, Arthur Gretton

摘要:

本文提出了一类成本在样本量内为线性的非参数两样本检验。给出了两个测试,都是基于代表每个分布的解析函数之间的距离的集合。第一个测试使用平滑的经验特征函数来表示分布,第二个测试使用再生核Hilbert空间中的分布嵌入。分析性意味着在有限数量的随机选择的位置/频率上几乎可以肯定地检测到分布的差异。新的测试是一致的,对一个更大的类的替代品比以前的线性时间测试的基础上(非平滑)的经验特征函数,而更快地比目前最先进的二次时间内核为基础的或能量距离为基础的测试。人工基准测试和挑战性的现实世界的测试问题的实验表明,我们的测试提供了一个更好的功率/时间权衡比竞争的方法,在某些情况下,更好的直接功率甚至比最昂贵的二次时间测试。这种性能优势即使在高维中也能保持,并且在低顺序统计量下无法观察到分布差异的情况下也能保持。

英文摘要:

We propose a class of nonparametric two-sample tests with a cost linear in the sample size. Two tests are given, both based on an ensemble of distances between analytic functions representing each of the distributions. The first test uses smoothed empirical characteristic functions to represent the distributions, the second uses distribution embeddings in a reproducing kernel Hilbert space. Analyticity implies that differences in the distributions may be detected almost surely at a finite number of randomly chosen locations/frequencies. The new tests are consistent against a larger class of alternatives than the previous linear-time tests based on the (non-smoothed) empirical characteristic functions, while being much faster than the current state-of-the-art quadratic-time kernel-based or energy distance-based tests. Experiments on artificial benchmarks and on challenging real-world testing problems demonstrate that our tests give a better power/time tradeoff than competing approaches, and in some cases, better outright power than even the most expensive quadratic-time tests. This performance advantage is retained even in high dimensions, and in cases where the difference in distributions is not observable with low order statistics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑