arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.03085cs.LGcs.CVcs.ITeess.IVmath.IT
收藏

用于图像去噪深度正则化压缩学习的无批次随机梯度下降

Batch-less stochastic gradient descent for compressive learning of deep regularization for image denoising

Univ. Bordeaux(波尔多大学);Bordeaux INP(波尔多国立理工学院);CNRS(法国国家科学研究中心);IMB(波尔多数学研究所)

Hui Shi, Yann Traonmilin, J-F Aujol

AI总结:

针对图像去噪中深度正则化学习计算负担大的问题,提出两种适配压缩学习框架的无批次SGD变体,可从高度压缩数据库恢复参数,性能优于原有低维方法且有收敛保证,可用于基于块的图像去噪。

摘要:

我们研究了借助干净信号或图像数据库提供的先验信息进行去噪的问题。若存在与数据特性高度适配的正则化项,变分法去噪的效率会很高。借助最大后验贝叶斯框架,这类正则化项可与数据分布建立系统性关联。通过深度神经网络(DNN),能够从大型训练数据库中恢复复杂分布。为降低该任务的计算负担,我们将压缩学习框架适配于由DNN参数化的正则化项的学习。我们提出了两种随机梯度下降(SGD)变体,用于从高度压缩的数据库中恢复深度正则化参数。这些算法的性能优于最初提出的、仅适用于低维信号且每次迭代需使用整个数据库信息的方法,同时还具备经典SGD的收敛保证。得益于这些改进,我们证明该方法可应用于基于图像块的图像去噪。

英文摘要:

We consider the problem of denoising with the help of prior information taken from a database of clean signals or images. Denoising with variational methods is very efficient if a regularizer well adapted to the nature of the data is available. Thanks to the maximum a posteriori Bayesian framework, such regularizer can be systematically linked with the distribution of the data. With deep neural networks (DNN), complex distributions can be recovered from a large training database.To reduce the computational burden of this task, we adapt the compressive learning framework to the learning of regularizers parametrized by DNN. We propose two variants of stochastic gradient descent (SGD) for the recovery of deep regularization parameters from a heavily compressed database. These algorithms outperform the initially proposed method that was limited to low-dimensional signals, each iteration using information from the whole database. They also benefit from classical SGD convergence guarantees. Thanks to these improvements we show that this method can be applied for patch based image denoising.}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑