arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1205.6935cs.ITmath.IT
收藏

最小化相关信息损失的信号增强

Signal Enhancement as Minimization of Relevant Information Loss

Bernhard C. Geiger, Gernot Kubin

摘要:

我们引入了相关信息损失的概念,目的是在信息理论方面铸造的信号增强问题。我们表明,许多算法从机器学习可以重新使用相关的信息损失,这使得他们的应用程序,上述问题。作为一个特殊的例子,我们分析了主成分分析的降维,讨论其最优性,并表明,相关的信息损失确实可以消失,如果相关的信息集中在一个低维的输入空间的子空间。

英文摘要:

We introduce the notion of relevant information loss for the purpose of casting the signal enhancement problem in information-theoretic terms. We show that many algorithms from machine learning can be reformulated using relevant information loss, which allows their application to the aforementioned problem. As a particular example we analyze principle component analysis for dimensionality reduction, discuss its optimality, and show that the relevant information loss can indeed vanish if the relevant information is concentrated on a lower-dimensional subspace of the input space.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑