arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2405.09873cs.CVeess.IV

IRSRMamba:通过基于 Mamba 的小波变换特征调制模型实现红外图像超分辨率

IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Model

Tohoku University(东北大学);Yale University(耶鲁大学)

Yongsong Huang, Tomo Miyazaki, Xiaofeng Liu, Shinichiro Omachi

AI总结:

针对红外图像超分辨率中的长程依赖与多尺度特征难题,提出 IRSRMamba,通过小波变换特征调制和 SSM 语义一致性损失改善重建质量,并在多项指标上超越现有方法。

摘要:

红外图像超分辨率需要长程依赖建模和多尺度特征提取,以应对同质背景、弱边缘和稀疏纹理等挑战。尽管基于 Mamba 的状态空间模型(SSM)以线性复杂度在全局依赖建模方面表现出色,但其分块处理会破坏空间一致性,从而限制其在红外图像重建中的有效性。我们提出 IRSRMamba,这是一种新颖框架,融合用于多尺度适应的小波变换特征调制,以及基于 SSM 的语义一致性损失,以恢复碎片化的上下文信息。该设计增强了全局—局部特征融合、结构连贯性和精细细节保持,同时减轻分块导致的伪影。在基准数据集上的实验表明,IRSRMamba 在 PSNR、SSIM 和感知质量方面优于最先进方法。本工作确立了基于 Mamba 的架构作为高保真红外图像增强的有前景方向。代码可在 https://github.com/yongsongH/IRSRMamba 获取。

英文摘要:

Infrared image super-resolution demands long-range dependency modeling and multi-scale feature extraction to address challenges such as homogeneous backgrounds, weak edges, and sparse textures. While Mamba-based state-space models (SSMs) excel in global dependency modeling with linear complexity, their block-wise processing disrupts spatial consistency, limiting their effectiveness for IR image reconstruction. We propose IRSRMamba, a novel framework integrating wavelet transform feature modulation for multi-scale adaptation and an SSMs-based semantic consistency loss to restore fragmented contextual information. This design enhances global-local feature fusion, structural coherence, and fine-detail preservation while mitigating block-induced artifacts. Experiments on benchmark datasets demonstrate that IRSRMamba outperforms state-of-the-art methods in PSNR, SSIM, and perceptual quality. This work establishes Mamba-based architectures as a promising direction for high-fidelity IR image enhancement. Code are available at https://github.com/yongsongH/IRSRMamba.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑