arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1010.5734cs.ITmath.IT
收藏

利用稀疏表示中的统计相关性进行信号恢复

Exploiting Statistical Dependencies in Sparse Representations for Signal Recovery

Tomer Peleg, Yonina C. Eldar, Michael Elad

摘要:

信号建模是众多信号和图像处理应用的核心。最近的一种方法,引起了相当大的关注是稀疏表示建模,其中的信号被假定为从一个给定的字典的几个原子的组合产生。在这项工作中,我们考虑贝叶斯设置和超越原子之间的独立性的经典假设。本文的主要目标是引入一个统计模型,考虑到这种依赖关系,并显示如何使用该模型的稀疏信号恢复。我们遵循最近的两个作品的建议,并假设稀疏模式是由玻尔兹曼机,一种常用的图形模型。对于一般的依赖模型,稀疏表示的精确MAP和MMSE估计在计算上变得复杂。为了简化计算,我们提出了贪婪近似的MAP和MMSE估计。然后,我们考虑一个特殊的情况下,精确的MAP是可行的,通过假设字典是单一的,依赖模型对应于一定的稀疏图。利用这种结构,我们开发了一个有效的消息传递算法,恢复底层信号。当定义底层图的模型参数是未知的,我们提出了一种算法,直接从数据中学习这些参数,导致自适应稀疏信号恢复的迭代方案。我们的方法的有效性在现实生活中的信号-自然图像的补丁-在那里我们比较去噪性能与以前的恢复方法,不利用统计依赖性。

英文摘要:

Signal modeling lies at the core of numerous signal and image processing applications. A recent approach that has drawn considerable attention is sparse representation modeling, in which the signal is assumed to be generated as a combination of a few atoms from a given dictionary. In this work we consider a Bayesian setting and go beyond the classic assumption of independence between the atoms. The main goal of this paper is to introduce a statistical model that takes such dependencies into account and show how this model can be used for sparse signal recovery. We follow the suggestion of two recent works and assume that the sparsity pattern is modeled by a Boltzmann machine, a commonly used graphical model. For general dependency models, exact MAP and MMSE estimation of the sparse representation becomes computationally complex. To simplify the computations, we propose greedy approximations of the MAP and MMSE estimators. We then consider a special case in which exact MAP is feasible, by assuming that the dictionary is unitary and the dependency model corresponds to a certain sparse graph. Exploiting this structure, we develop an efficient message passing algorithm that recovers the underlying signal. When the model parameters defining the underlying graph are unknown, we suggest an algorithm that learns these parameters directly from the data, leading to an iterative scheme for adaptive sparse signal recovery. The effectiveness of our approach is demonstrated on real-life signals - patches of natural images - where we compare the denoising performance to that of previous recovery methods that do not exploit the statistical dependencies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑