一种非参数k近邻熵估计器
A non-parametric k-nearest neighbour entropy estimator
AI总结:
本文提出一种非参数k近邻熵估计器,通过考虑k近邻区域内的非均匀概率密度,改进经典Kozachenko-Leonenko估计器,在高维数据、近函数关系及边际方差差异显著时表现更优。
摘要:
本文提出了一种基于k近邻的非参数熵估计器。该估计器改进了经典的Kozachenko-Leonenko估计器,通过考虑k近邻区域内的非均匀概率密度。其目标是改进经典估计器在三种情况下的性能:首先,当随机变量的维度较大时;其次,当存在近函数关系导致随机变量成分之间高度相关时;最后,当随机变量成分的边际方差显著不同时。本文提供了所提估计器和经典估计器的误差启发式分析。最后,所提估计器在依次增加的维度和存在近函数关系的情况下,对多种分布进行了测试。其性能与经典估计器相比显示出显著改进。
英文摘要:
A non-parametric k-nearest neighbour based entropy estimator is proposed. It improves on the classical Kozachenko-Leonenko estimator by considering non-uniform probability densities in the region of k-nearest neighbours around each sample point. It aims at improving the classical estimators in three situations: first, when the dimensionality of the random variable is large; second, when near-functional relationships leading to high correlation between components of the random variable are present; and third, when the marginal variances of random variable components vary significantly with respect to each other. Heuristics on the error of the proposed and classical estimators are presented. Finally, the proposed estimator is tested for a variety of distributions in successively increasing dimensions and in the presence of a near-functional relationship. Its performance is compared with a classical estimator and shown to be a significant improvement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。