arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.01334cs.DS
收藏

基于汇总统计的数据集之间的距离

Distances between Data Sets Based on Summary Statistics

Nikolaj Tatti

摘要:

相似度和距离的概念在数据采掘中是至关重要的。我们考虑的问题,定义两个数据集之间的距离,通过比较汇总统计计算的数据集。我们的距离的初始定义是基于某些分布集合的几何概念。我们表明,这个距离可以计算在立方时间,它有几个直观的属性。我们还证明了这个距离是满足一定假设的唯一Mahalanobis距离。我们还证明,如果我们处理的是二进制数据集,那么距离可以自然地由某些奇偶校验函数表示,并且可以在线性时间内进行评估。我们对真实世界数据的实证测试表明,距离效果很好。

英文摘要:

The concepts of similarity and distance are crucial in data mining. We consider the problem of defining the distance between two data sets by comparing summary statistics computed from the data sets. The initial definition of our distance is based on geometrical notions of certain sets of distributions. We show that this distance can be computed in cubic time and that it has several intuitive properties. We also show that this distance is the unique Mahalanobis distance satisfying certain assumptions. We also demonstrate that if we are dealing with binary data sets, then the distance can be represented naturally by certain parity functions, and that it can be evaluated in linear time. Our empirical tests with real world data show that the distance works well.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑