arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2412.07222cs.CVcs.AIeess.IV

MPSI:用于逐像素序列交互图像超分辨率的 Mamba 增强模型

MPSI: Mamba enhancement model for pixel-wise sequential interaction Image Super-Resolution

University of Sydney(悉尼大学)

Yuchun He, Yuhan He

AI总结:

针对单图像超分辨率中长序列与全局像素交互建模不足及层间特征丢失问题,本文提出 MPSI,利用 CMB 和 MCRM 增强逐像素序列交互并复用多层特征,实验达到 SOTA。

摘要:

单图像超分辨率(SR)长期以来一直是计算机视觉领域的一项挑战。尽管深度学习的出现催生了众多旨在解决这一长期问题的方法,但当前方法在建模长序列信息方面仍面临困难,从而限制了其有效捕获全局像素交互的能力。为应对这一挑战并获得更优的 SR 结果,我们提出了 Mamba 逐像素序列交互网络(MPSI),旨在加强信息长程连接的建立,尤其关注逐像素序列交互。我们提出 Channel-Mamba Block(CMB),通过有效建模长序列信息来捕获全面的像素交互信息。此外,在现有 SR 方法中,仍存在忽视前序层所提取特征的问题,导致有价值的特征信息丢失。尽管某些现有模型努力保留这些特征,但它们往往难以在所有层之间建立连接。为克服这一局限,MPSI 引入了 Mamba channel recursion module(MCRM),最大限度保留来自早期层的有价值特征信息,从而促进从多个层级获取像素序列交互信息。通过大量实验,我们证明 MPSI 在图像重建结果方面优于现有超分辨率方法,达到了最先进性能。

英文摘要:

Single image super-resolution (SR) has long posed a challenge in the field of computer vision. While the advent of deep learning has led to the emergence of numerous methods aimed at tackling this persistent issue, the current methodologies still encounter challenges in modeling long sequence information, leading to limitations in effectively capturing the global pixel interactions. To tackle this challenge and achieve superior SR outcomes, we propose the Mamba pixel-wise sequential interaction network (MPSI), aimed at enhancing the establishment of long-range connections of information, particularly focusing on pixel-wise sequential interaction. We propose the Channel-Mamba Block (CMB) to capture comprehensive pixel interaction information by effectively modeling long sequence information. Moreover, in the existing SR methodologies, there persists the issue of the neglect of features extracted by preceding layers, leading to the loss of valuable feature information. While certain existing models strive to preserve these features, they frequently encounter difficulty in establishing connections across all layers. To overcome this limitation, MPSI introduces the Mamba channel recursion module (MCRM), which maximizes the retention of valuable feature information from early layers, thereby facilitating the acquisition of pixel sequence interaction information from multiple-level layers. Through extensive experimentation, we demonstrate that MPSI outperforms existing super-resolution methods in terms of image reconstruction results, attaining state-of-the-art performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑