arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.09697cs.CV

HSIDMamba:探索用于高光谱去噪的双向状态空间模型

HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising

National Key Laboratory of Human-Machine Hybrid Augmented Intelligence(人机混合增强智能国家重点实验室);National Engineering Research Center for Visual Information and Applications(视觉信息与应用国家工程研究中心);Institute of Artificial Intelligence and Robotics(人工智能与机器人研究院);school of software(软件学院)

Yang Liu, Jiahua Xiao, Xiang Song, Yu Guo, Peilin Jiang, Haiwei Yang, Fei Wang

AI总结:

针对高光谱图像去噪中全局上下文建模的效率限制,提出基于双向状态空间模型的HSIDMamba网络,通过多方向扫描与光谱注意力机制增强空间-光谱交互,实现最先进去噪性能且计算效率显著提升。

摘要:

在高光谱图像(HSI)去噪中,有效建模全局上下文信息至关重要,但现有使用卷积或Transformer的方法仍面临局部性或计算效率的限制。受具有近线性计算复杂度和高效长程建模能力的新兴选择性状态空间模型(Mamba)启发,我们提出了一种名为HSIDMamba(HSDM)的新型HSI去噪网络。HSDM专为高效且有效地捕获HSI去噪的潜在空间-光谱依赖关系而设计。具体而言,HSDM包含多个高光谱连续扫描块(HCSB)以增强空间-光谱交互。HCSB连接前向和后向扫描,并通过状态空间模型(SSM)增强来自八个方向的信息,加强了HSDM的上下文表示学习,更有效地提升了去噪性能。此外,为了增强光谱信息的利用并缓解长程扫描导致的退化问题,引入了光谱注意力机制。在HSI去噪基准上的广泛评估验证了HSDM的优越性能,实现了最先进的性能,且效率比Transformer方法SERT高出31%。

英文摘要:

Effectively modeling global context information in hyperspectral image (HSI) denoising is crucial, but prevailing methods using convolution or transformers still face localized or computational efficiency limitations. Inspired by the emerging Selective State Space Model (Mamba) with nearly linear computational complexity and efficient long-term modeling, we present a novel HSI denoising network named HSIDMamba (HSDM). HSDM is tailored to exploit the capture of potential spatial-spectral dependencies effectively and efficiently for HSI denoising. In particular, HSDM comprises multiple Hyperspectral Continuous Scan Blocks (HCSB) to strengthen spatial-spectral interactions. HCSB links forward and backward scans and enhances information from eight directions through the State Space Model (SSM), strengthening the context representation learning of HSDM and improving denoising performance more effectively. In addition, to enhance the utilization of spectral information and mitigate the degradation problem caused by long-range scanning, spectral attention mechanism. Extensive evaluations against HSI denoising benchmarks validate the superior performance of HSDM, achieving state-of-the-art performance and surpassing the efficiency of the transformer method SERT by 31%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑