arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 0802.2050stat.MLstat.APstat.ME
收藏

FINE:费舍尔信息非参数嵌入

FINE: Fisher Information Non-parametric Embedding

Kevin M. Carter, Raviv Raich, William G. Finn, Alfred O. Hero

摘要:

我们考虑的问题,聚类,分类和可视化的高维数据时,没有直接的欧几里德表示存在。通常,这些任务通过首先将高维数据减少到某个较低维的欧几里得空间来执行,因为已经为该任务开发了许多流形学习方法。然而,在许多实际问题中,欧氏流形的假设是不合理的。在这些情况下,更合适的假设是数据位于统计流形或概率密度函数(PDF)流形上。在本文中,我们建议使用信息几何的属性,以定义使用费舍尔信息度量的数据集之间的相似性。我们将展示这个度量可以使用完全非参数化的方法来近似,因为流形的参数化通常是未知的。此外,通过使用多维缩放方法,我们能够将相应的PDF嵌入到一个低维的欧几里得空间。这不仅允许对数据进行分类,还允许对流形进行可视化。作为一个整体,我们将我们的框架称为费舍尔信息非参数嵌入(FINE),并说明其在各种实际问题上的用途,包括生物医学应用和文档分类。

英文摘要:

We consider the problems of clustering, classification, and visualization of high-dimensional data when no straightforward Euclidean representation exists. Typically, these tasks are performed by first reducing the high-dimensional data to some lower dimensional Euclidean space, as many manifold learning methods have been developed for this task. In many practical problems however, the assumption of a Euclidean manifold cannot be justified. In these cases, a more appropriate assumption would be that the data lies on a statistical manifold, or a manifold of probability density functions (PDFs). In this paper we propose using the properties of information geometry in order to define similarities between data sets using the Fisher information metric. We will show this metric can be approximated using entirely non-parametric methods, as the parameterization of the manifold is generally unknown. Furthermore, by using multi-dimensional scaling methods, we are able to embed the corresponding PDFs into a low-dimensional Euclidean space. This not only allows for classification of the data, but also visualization of the manifold. As a whole, we refer to our framework as Fisher Information Non-parametric Embedding (FINE), and illustrate its uses on a variety of practical problems, including bio-medical applications and document classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑