arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1411.2883cs.ITcs.LGmath.IT
收藏

基于互信息的两变量相关测度的新估计:性质及快速实现

A new estimate of mutual information based measure of dependence between two variables: properties and fast implementation

Indian Statistical Institute(印度统计研究所)

Namita Jain, C. A. Murthy

摘要:

本文提出了一种新的方法来估计现有的互信息的依赖性度量使用直方图密度估计。为直方图寻找合适的区间长度是一个悬而未决的问题。我们提出了一种新的方法来计算直方图的bin长度使用点之间的最大分离函数。所选择的箱长导致直方图方法的一致密度估计。由此获得的密度值用于计算现有依赖性度量的估计。该估计被命名为基于互信息的依赖性指数(Intermediate Information Based Dependence Index,简称为DSI)。还叙述了它的一些重要性质。所提出的方法的性能进行了比较,普遍接受的措施,如距离相关(dcor),最大信息系数(MINE)的准确性和计算复杂性的帮助下,几个人工数据集与不同数量的噪声。所提出的方法是能够检测变量之间的多种类型的关系,而不作任何假设的关系的函数形式。所提出的方法的功率统计说明他们在检测非线性关系的有效性。因此,它能够实现通用性而没有高的假阳性率。在现实生活中的数据集上,我们发现它比其他方法更有效。所提出的方法被发现,以克服一些与装饰和矿山发生的限制。在计算方面,我们发现在时间和内存方面,dcor比dcor和MINE更好,这使得它适用于大型数据集。

英文摘要:

This article proposes a new method to estimate an existing mutual information based dependence measure using histogram density estimates. Finding a suitable bin length for histogram is an open problem. We propose a new way of computing the bin length for histogram using a function of maximum separation between points. The chosen bin length leads to consistent density estimates for histogram method. The values of density thus obtained are used to calculate an estimate of an existing dependence measure. The proposed estimate is named as Mutual Information Based Dependence Index (MIDI). Some important properties of MIDI have also been stated. The performance of the proposed method has been compared to generally accepted measures like Distance Correlation (dcor), Maximal Information Coefficient (MINE) in terms of accuracy and computational complexity with the help of several artificial data sets with different amounts of noise. The proposed method is able to detect many types of relationships between variables, without making any assumption about the functional form of the relationship. The power statistics of proposed method illustrate their effectiveness in detecting non linear relationship. Thus, it is able to achieve generality without a high rate of false positive cases. MIDI is found to work better on a real life data set than competing methods. The proposed method is found to overcome some of the limitations which occur with dcor and MINE. Computationally, MIDI is found to be better than dcor and MINE, in terms of time and memory, making it suitable for large data sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑