arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.10140cs.CV

Hi-Mamba:用于高效图像超分辨率的分层Mamba

Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolution

East China Normal University(华东师范大学);Huawei Technologies Ltd(华为技术有限公司);Shanghai Jiaotong University(上海交通大学)

Junbo Qiao, Jincheng Liao, Wei Li, Yulun Zhang, Yong Guo, Yi Wen, Zhangxizi Qiu, Jiao Xie, Jie Hu, Shaohui Lin

AI总结:

提出Hi-Mamba网络,通过结合单向扫描的分层Mamba块和方向交替分层Mamba组,在减少计算开销的同时增强多尺度上下文与空间关系建模,实现了高效且优越的图像超分辨率性能。

摘要:

状态空间模型(SSM),如Mamba,在以线性复杂度建模长距离依赖方面展现出强大的表示能力,在从高层到低层视觉任务中均实现了成功应用。然而,SSM的序列特性要求在不同方向进行多次扫描,以弥补将图像展开为一维序列时空间依赖性的损失。这种多方向扫描策略显著增加了计算开销,对于高分辨率图像处理而言是无法承受的。为了解决这个问题,我们提出了一种新颖的分层Mamba网络,即Hi-Mamba,用于图像超分辨率(SR)。Hi-Mamba包含两个关键设计:(1)分层Mamba块(HMB),由局部SSM(L-SSM)和区域SSM(R-SSM)组装而成,两者均采用单向扫描,聚合多尺度表示以增强上下文建模能力。(2)方向交替分层Mamba组(DA-HMG)将异构单向扫描分配到级联的HMB中,以丰富空间关系建模。大量实验证明了Hi-Mamba在五个基准数据集上实现高效SR的优越性。例如,与强大的轻量级MambaIR相比,Hi-Mamba在Manga109数据集的×3 SR上实现了0.29 dB的显著PSNR提升。

英文摘要:

State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's sequential nature necessitates multiple scans in different directions to compensate for the loss of spatial dependency when unfolding the image into a 1D sequence. This multi-direction scanning strategy significantly increases the computation overhead and is unbearable for high-resolution image processing. To address this problem, we propose a novel Hierarchical Mamba network, namely, Hi-Mamba, for image super-resolution (SR). Hi-Mamba consists of two key designs: (1) The Hierarchical Mamba Block (HMB) assembled by a Local SSM (L-SSM) and a Region SSM (R-SSM) both with the single-direction scanning, aggregates multi-scale representations to enhance the context modeling ability. (2) The Direction Alternation Hierarchical Mamba Group (DA-HMG) allocates the isomeric single-direction scanning into cascading HMBs to enrich the spatial relationship modeling. Extensive experiments demonstrate the superiority of Hi-Mamba across five benchmark datasets for efficient SR. For example, Hi-Mamba achieves a significant PSNR improvement of 0.29 dB on Manga109 for $\times3$ SR, compared to the strong lightweight MambaIR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑