最小化相关信息损失的信号增强
Signal Enhancement as Minimization of Relevant Information Loss
摘要:
我们引入了相关信息损失的概念,目的是在信息理论方面铸造的信号增强问题。我们表明,许多算法从机器学习可以重新使用相关的信息损失,这使得他们的应用程序,上述问题。作为一个特殊的例子,我们分析了主成分分析的降维,讨论其最优性,并表明,相关的信息损失确实可以消失,如果相关的信息集中在一个低维的输入空间的子空间。
英文摘要:
We introduce the notion of relevant information loss for the purpose of casting the signal enhancement problem in information-theoretic terms. We show that many algorithms from machine learning can be reformulated using relevant information loss, which allows their application to the aforementioned problem. As a particular example we analyze principle component analysis for dimensionality reduction, discuss its optimality, and show that the relevant information loss can indeed vanish if the relevant information is concentrated on a lower-dimensional subspace of the input space.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。