arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.07918cs.CV

通过基于解混的丰度融合学习增强未注册超光谱图像超分辨率

Enhancing Unregistered Hyperspectral Image Super-Resolution via Unmixing-based Abundance Fusion Learning

Beijing Institute of Technology(北京理工大学);Hangzhou Dianzi University(杭州电子科技大学)

Yingkai Zhang, Tao Zhang, Jing Nie, Ying Fu

AI总结:

本文提出基于解混的丰度融合学习方法,通过解耦空间-光谱信息,提升未注册超光谱图像超分辨率的性能。

摘要:

未注册超光谱图像(HSI)超分辨率通常旨在利用未注册的高分辨率参考图像来增强低分辨率HSI。在本文中,我们提出了一种基于解混的融合框架,旨在解耦空间-光谱信息,同时减轻未注册融合的影响并提高SR模型的可学习性。具体来说,我们首先利用奇异值分解进行初始光谱解混,保留原始端成员,同时将后续网络用于增强初始丰度图。为了利用未注册参考的空问纹理,我们引入了一个由粗到细的可变形聚合模块,首先利用粗金字塔预测器估计像素级流和相似性图。它进一步执行细粒度子像素细化,以实现参考特征的可变形聚合。聚合特征随后通过一系列空间-通道丰度交叉注意力块进行细化。此外,还提出了一种空间-通道调制融合模块,通过动态门控权重合并编码器-解码器特征,从而获得高质量的高分辨率HSI。实验结果表明,在模拟和真实数据集上,我们提出的方法在超分辨率性能上达到了最先进的水平。代码将在https://github.com/yingkai-zhang/UAFL上提供。

英文摘要:

Unregistered hyperspectral image (HSI) super-resolution (SR) typically aims to enhance a low-resolution HSI using an unregistered high-resolution reference image. In this paper, we propose an unmixing-based fusion framework that decouples spatial-spectral information to simultaneously mitigate the impact of unregistered fusion and enhance the learnability of SR models. Specifically, we first utilize singular value decomposition for initial spectral unmixing, preserving the original endmembers while dedicating the subsequent network to enhancing the initial abundance map. To leverage the spatial texture of the unregistered reference, we introduce a coarse-to-fine deformable aggregation module, which first estimates a pixel-level flow and a similarity map using a coarse pyramid predictor. It further performs fine sub-pixel refinement to achieve deformable aggregation of the reference features. The aggregative features are then refined via a series of spatial-channel abundance cross-attention blocks. Furthermore, a spatial-channel modulated fusion module is presented to merge encoder-decoder features using dynamic gating weights, yielding a high-quality, high-resolution HSI. Experimental results on simulated and real datasets confirm that our proposed method achieves state-of-the-art super-resolution performance. The code will be available at https://github.com/yingkai-zhang/UAFL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑