arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1406.7638stat.ML
收藏

直接密度导数估计及其在库尔贝克-莱布勒散度逼近中的应用

Direct Density-Derivative Estimation and Its Application in KL-Divergence Approximation

Hiroaki Sasaki, Yung-Kyun Noh, Masashi Sugiyama

摘要:

密度导数的估计是统计数据分析中的通用工具。一种简单的方法是首先估计密度,然后计算其导数。然而,这样的两步方法并不能很好地工作,因为一个好的密度估计并不一定意味着一个好的密度导数估计。本文给出了一种直接逼近密度导数的方法,而不需要估计密度本身。我们提出的估计允许多维高阶密度导数的分析和计算效率的近似,所有的超参数可以通过交叉验证客观地选择的能力。我们进一步表明,建议的密度导数估计是有用的,通过度量学习提高非参数库尔贝克-莱布勒散度估计的准确性。实验证明了该方法在变化检测和特征选择方面的实用优势。

英文摘要:

Estimation of density derivatives is a versatile tool in statistical data analysis. A naive approach is to first estimate the density and then compute its derivative. However, such a two-step approach does not work well because a good density estimator does not necessarily mean a good density-derivative estimator. In this paper, we give a direct method to approximate the density derivative without estimating the density itself. Our proposed estimator allows analytic and computationally efficient approximation of multi-dimensional high-order density derivatives, with the ability that all hyper-parameters can be chosen objectively by cross-validation. We further show that the proposed density-derivative estimator is useful in improving the accuracy of non-parametric KL-divergence estimation via metric learning. The practical superiority of the proposed method is experimentally demonstrated in change detection and feature selection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑