arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.05417eess.IVcs.LGstat.ML
收藏

BP-DIP:一种基于反投影的深度图像先验

BP-DIP: A Backprojection based Deep Image Prior

Tel Aviv University(特拉维夫大学)

Jenny Zukerman, Tom Tirer, Raja Giryes

摘要:

深度神经网络是许多计算机视觉任务的强大工具,包括图像恢复,展示最先进的结果。然而,一旦训练中使用的观察模型与测试时的观察模型不匹配,深度学习方法的性能往往会下降。此外,大多数深度学习方法需要大量的训练数据,而这些数据在许多应用程序中是不可访问的。为了减轻这些缺点,我们建议结合两种图像恢复方法:(i)深度图像先验(DIP),它使用给定的退化图像在测试时间从头开始训练卷积神经网络(CNN)。它不需要任何训练数据,并建立在由CNN架构施加的隐式先验上;以及(ii)反向投影(BP)保真度项,这是通常用于以前DIP作品的标准最小二乘损失的替代方案。我们证明了所提出的方法,称为BP-DIP,在去模糊任务的性能,并显示其优于普通DIP,具有更高的PSNR值和更好的推理运行时间。

英文摘要:

Deep neural networks are a very powerful tool for many computer vision tasks, including image restoration, exhibiting state-of-the-art results. However, the performance of deep learning methods tends to drop once the observation model used in training mismatches the one in test time. In addition, most deep learning methods require vast amounts of training data, which are not accessible in many applications. To mitigate these disadvantages, we propose to combine two image restoration approaches: (i) Deep Image Prior (DIP), which trains a convolutional neural network (CNN) from scratch in test time using the given degraded image. It does not require any training data and builds on the implicit prior imposed by the CNN architecture; and (ii) a backprojection (BP) fidelity term, which is an alternative to the standard least squares loss that is usually used in previous DIP works. We demonstrate the performance of the proposed method, termed BP-DIP, on the deblurring task and show its advantages over the plain DIP, with both higher PSNR values and better inference run-time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑