arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1902.07165cs.DBcs.IR
收藏

比较苹果和橘子:测量探索性数据采掘结果之间的差异

Comparing Apples and Oranges: Measuring Differences between Exploratory Data Mining Results

Nikolaj Tatti, Jilles Vreeken

摘要:

在探索性数据采掘中,判定两种不同挖掘算法的结果是否提供了显著不同的信息是一个重要但尚未充分研究的开放问题。无论目标是选择信息量最大的结果进行分析,还是决定哪种挖掘方法最有可能提供最新颖的见解,我们都必须能够说出不同方法提供的不同结果所提供的信息有多不同。在本文中,我们采取的第一步,比较探索性的数据采掘结果的二进制数据。我们建议有意义地将结果转换成一组嘈杂的瓷砖,并比较这些集之间的最大熵建模和Kullback-Leibler分歧,从信息论有根据的概念。因此,我们构建了高度灵活的测量,并且允许我们自然地包括背景知识,使得可以从用户已经知道的角度来测量结果的差异。此外,增加其可解释性,它符合Jaccard相异性时,我们只考虑确切的瓷砖。我们的方法提供了一种手段来研究和告诉不同的探索性数据采掘方法的结果之间的差异。作为一个应用程序,我们表明,我们的措施也可以用来确定哪些部分的结果最好重新描述其他结果。此外,我们研究其使用迭代数据采掘,其中一个迭代地希望找到的结果,将提供最大的新信息。实验评估表明,我们的措施给出了有意义的结果,正确地识别方法,在性质上是相似的,自动提供声音的结果重新描述,是非常适用于迭代数据采掘。

英文摘要:

Deciding whether the results of two different mining algorithms provide significantly different information is an important, yet understudied, open problem in exploratory data mining. Whether the goal is to select the most informative result for analysis, or to decide which mining approach will most likely provide the most novel insight, it is essential that we can tell how different the information is that different results by possibly different methods provide. In this paper we take a first step towards comparing exploratory data mining results on binary data. We propose to meaningfully convert results into sets of noisy tiles, and compare between these sets by Maximum Entropy modelling and Kullback-Leibler divergence, well-founded notions from Information Theory. We so construct a measure that is highly flexible, and allows us to naturally include background knowledge, such that differences in results can be measured from the perspective of what a user already knows. Furthermore, adding to its interpretability, it coincides with Jaccard dissimilarity when we only consider exact tiles. Our approach provides a means to study and tell differences between results of different exploratory data mining methods. As an application, we show that our measure can also be used to identify which parts of results best redescribe other results. Furthermore, we study its use for iterative data mining, where one iteratively wants to find that result that will provide maximal novel information. Experimental evaluation shows our measure gives meaningful results, correctly identifies methods that are similar in nature, automatically provides sound redescriptions of results, and is highly applicable for iterative data mining.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑