$M$分布相异性的核度量
A Kernel Measure of Dissimilarity between $M$ Distributions
摘要:
给定定义在一般可测空间上的$M \geq 2$分布,我们引入了多样本相异性(KMD)的非参数(核)度量-一个量化$M$分布之间差异的参数。当且仅当所有的$M$分布相同时,总体KMD为0,当且仅当所有的分布相互奇异时,总体KMD为1。此外,KMD还具有许多与$f$ -发散相关的性质,如数据处理不等式和双射变换下的不变性。KMD的样本估计值基于$M$分布的独立观察值,可以使用$k$ -最近邻图(对于固定的$k \ge 1$)在近线性时间(最多为对数因子)内计算。我们开发了一个易于实施的测试$M$分布的平等性的基础上的样本KMD是一致的,对所有的替代品,其中至少有两个分布是不相等的。我们证明了样本KMD的中心极限定理,并提供了一个完整的表征的渐近功率的测试,以及其检测阈值。通过真实和合成数据的例子证明了我们的措施的有用性;我们的方法也在R包中实现。
英文摘要:
Given $M \geq 2$ distributions defined on a general measurable space, we introduce a nonparametric (kernel) measure of multi-sample dissimilarity (KMD) -- a parameter that quantifies the difference between the $M$ distributions. The population KMD, which takes values between 0 and 1, is 0 if and only if all the $M$ distributions are the same, and 1 if and only if all the distributions are mutually singular. Moreover, KMD possesses many properties commonly associated with $f$-divergences such as the data processing inequality and invariance under bijective transformations. The sample estimate of KMD, based on independent observations from the $M$ distributions, can be computed in near linear time (up to logarithmic factors) using $k$-nearest neighbor graphs (for $k \ge 1$ fixed). We develop an easily implementable test for the equality of $M$ distributions based on the sample KMD that is consistent against all alternatives where at least two distributions are not equal. We prove central limit theorems for the sample KMD, and provide a complete characterization of the asymptotic power of the test, as well as its detection threshold. The usefulness of our measure is demonstrated via real and synthetic data examples; our method is also implemented in an R package.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。