arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.01725eess.SPcs.CV
收藏

使用等变深度学习成像

Imaging with Equivariant Deep Learning

University of Edinburgh(爱丁堡大学);University of Bath(巴斯大学);University of Cambridge(剑桥大学);Centre National de Recherche Scientifique (CNRS)(法国国家科学研究中心);École Normale Supériere de Lyon(里昂高等师范学院)

Dongdong Chen, Mike Davies, Matthias J. Ehrhardt, Carola-Bibiane Schönlieb, Ferdia Sherry, Julián Tachella

摘要:

从早期的图像处理到现代的计算成像,成功的模型和算法都依赖于自然信号的一个基本属性:对称性。这里,对称性是指信号集对诸如平移、旋转或缩放等变换的不变性。对称性也可以以等方差的形式纳入深度神经网络,从而实现更有效的数据学习。虽然近年来在设计用于图像分类的端到端等变网络方面取得了重要进展,但计算成像为等变网络解决方案带来了独特的挑战,因为我们通常只能通过一些本身可能不是等变的噪声病态前向算子来观察图像。我们回顾了新兴领域的等变成像,并展示了它如何可以提供改进的泛化和新的成像机会。一路上,我们展示了采集物理和群体行动之间的相互作用,并链接到迭代重建,盲压缩感知和自我监督学习。

英文摘要:

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal sets to transformations such as translation, rotation or scaling. Symmetry can also be incorporated into deep neural networks in the form of equivariance, allowing for more data-efficient learning. While there has been important advances in the design of end-to-end equivariant networks for image classification in recent years, computational imaging introduces unique challenges for equivariant network solutions since we typically only observe the image through some noisy ill-conditioned forward operator that itself may not be equivariant. We review the emerging field of equivariant imaging and show how it can provide improved generalization and new imaging opportunities. Along the way we show the interplay between the acquisition physics and group actions and links to iterative reconstruction, blind compressed sensing and self-supervised learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑