arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.18679cs.CV

通过通道级功能分解和流形正则化实现高效的退化无关图像恢复

Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization

Mohamed bin Zayed University of Artificial Intelligence(莫扎德·本·泽德人工智能大学);University of Trento(特伦托大学);ETH Zürich(苏黎世联邦理工学院);HKUST (GZ)(香港科技大学(广州));Peking University(北京大学);University of California, Merced(加州大学默塞德分校)

Bin Ren, Yawei Li, Xu Zheng, Yuqian Fu, Danda Pani Paudel, Hong Liu, Ming-Hsuan Yang, Luc Van Gool, Nicu Sebe

AI总结:

MIRAGE通过通道级功能分解和流形正则化,在高效性与性能之间取得平衡,实现退化无关图像恢复的先进性能。

摘要:

退化无关图像恢复旨在通过一个统一的模型处理多种损坏,但面临在不同退化类型之间平衡效率和性能的根本挑战。现有方法要么牺牲效率以换取通用性,要么无法捕捉各种退化所需的不同的表示要求。我们提出了MIRAGE,一个高效的框架,通过两个关键创新来解决这些挑战。首先,我们提出了一种通道级功能分解,通过将CNN、注意力和MLP分支分别用于处理局部纹理、全局上下文和通道统计,系统性地重新利用注意力机制中的通道冗余。这种原理性的分解在实现退化无关学习的同时,实现了优越的效率-性能权衡。其次,我们引入了流形正则化,通过在对称正定(SPD)空间中进行跨层对比对齐,实验证明可以提高不同退化类型下的特征一致性和泛化能力。广泛的实验表明,MIRAGE在各种一站式图像恢复(IR)设置中实现了最先进的性能,同时具有显著的效率,优于现有方法,同时为挑战性的未见过的IR场景提供了可扩展且通用的解决方案。

英文摘要:

Degradation-agnostic image restoration aims to handle diverse corruptions with one unified model, but faces fundamental challenges in balancing efficiency and performance across different degradation types. Existing approaches either sacrifice efficiency for versatility or fail to capture the distinct representational requirements of various degradations. We present MIRAGE, an efficient framework that addresses these challenges through two key innovations. First, we propose a channel-wise functional decomposition that systematically repurposes channel redundancy in attention mechanisms by assigning CNN, attention, and MLP branches to handle local textures, global context, and channel statistics, respectively. This principled decomposition enables degradation-agnostic learning while achieving superior efficiency-performance trade-offs. Second, we introduce manifold regularization that performs cross-layer contrastive alignment in Symmetric Positive Definite (SPD) space, which empirically improves feature consistency and generalization across degradation types. Extensive experiments demonstrate that MIRAGE achieves state-of-the-art performance with remarkable efficiency, outperforming existing methods in various all-in-one IR settings while offering a scalable and generalizable solution for challenging unseen IR scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑