arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1903.09280q-bio.QM
收藏

具有误差线和受控偏差的实值数据互信息估计

Estimation of mutual information for real-valued data with error bars and controlled bias

Caroline M. Holmes, Ilya Nemenman

摘要:

(多维)实值变量之间的互信息估计用于复杂系统、生物系统和最近的量子系统的分析。这个估计是一个困难的问题,并且普遍良好的估计可证明不存在。Kraskov等人(PRE,2004)介绍了一种成功的互信息估计方法,该方法基于相邻数据点之间的距离统计,经验上适用于广泛的潜在概率分布。在这里,我们通过(i)扩大其适用范围,并通过提供(ii)一个自洽的方式来验证偏差的存在,(iii)一种方法来估计其方差,(iv)一个标准选择的自由参数的值的估计量。我们证明了我们的估计的合成数据集,以及神经生理和系统生物学数据集的性能。

英文摘要:

Estimation of mutual information between (multidimensional) real-valued variables is used in analysis of complex systems, biological systems, and recently also quantum systems. This estimation is a hard problem, and universally good estimators provably do not exist. Kraskov et al. (PRE, 2004) introduced a successful mutual information estimation approach based on the statistics of distances between neighboring data points, which empirically works for a wide class of underlying probability distributions. Here we improve this estimator by (i) expanding its range of applicability, and by providing (ii) a self-consistent way of verifying the absence of bias, (iii) a method for estimation of its variance, and (iv) a criterion for choosing the values of the free parameter of the estimator. We demonstrate the performance of our estimator on synthetic data sets, as well as on neurophysiological and systems biology data sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑