arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.05573cs.LGstat.ML
收藏

见证双样本检验

A Witness Two-Sample Test

Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Google Research(谷歌研究院)

Jonas M. Kübler, Wittawat Jitkrittum, Bernhard Schölkopf, Krikamol Muandet

摘要:

最大平均离散度(MMD)是解决双样本问题的最先进的非参数检验。它的统计量由见证函数的期望值的差异给出,见证函数是一个实值函数,定义为一组基点上的核评估的加权和。通常,在训练集上优化内核,并且在单独的测试集上执行假设测试以避免过拟合(即,控制I型错误)。也就是说,测试集用于同时估计期望值和定义基点,而训练集仅用于选择内核并被丢弃。在这项工作中,我们建议使用训练数据来定义权重和基点,以获得更好的数据效率。我们表明:1)新的测试是一致的,并具有良好控制的I型错误; 2)最佳见证函数由与内核相关的再生内核希尔伯特空间中的精度加权平均值给出;以及3)所提出的测试的测试能力与MMD和其他现代测试相当或超过MMD和其他现代测试,如在具有挑战性的合成和真实问题(例如,Higgs数据)。

英文摘要:

The Maximum Mean Discrepancy (MMD) has been the state-of-the-art nonparametric test for tackling the two-sample problem. Its statistic is given by the difference in expectations of the witness function, a real-valued function defined as a weighted sum of kernel evaluations on a set of basis points. Typically the kernel is optimized on a training set, and hypothesis testing is performed on a separate test set to avoid overfitting (i.e., control type-I error). That is, the test set is used to simultaneously estimate the expectations and define the basis points, while the training set only serves to select the kernel and is discarded. In this work, we propose to use the training data to also define the weights and the basis points for better data efficiency. We show that 1) the new test is consistent and has a well-controlled type-I error; 2) the optimal witness function is given by a precision-weighted mean in the reproducing kernel Hilbert space associated with the kernel; and 3) the test power of the proposed test is comparable or exceeds that of the MMD and other modern tests, as verified empirically on challenging synthetic and real problems (e.g., Higgs data).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑