S2WMamba:一种基于小波的Mamba双分支网络用于全色合成
S2WMamba: A Wavelet-Assisted Mamba-Based Dual-Branch Network For Pansharpening
AI总结:
本文提出S2WMamba网络,通过小波变换分离模态特定频率信息,改进全色合成中的空间细节与光谱保真度的处理,实验表明其在PSNR和HQNR指标上优于现有方法。
摘要:
全色合成通过融合高分辨率全色图像与低分辨率多谱段图像生成高分辨率多谱段图像。关键难点在于联合处理全色和多谱段特征时,空间细节增强与光谱保真度常交织。为此,本文提出S2WMamba框架,通过局部2D Haar DWT精确分离全色图像的空间边缘和纹理,同时通过新型通道式1D Haar DWT将每个像素的光谱视为1D信号,分离共享光谱基底与波段特定变化,严格限制光谱失真。所得光谱分支将小波提取的空间细节注入多谱段特征,空间分支则利用DWT1D过程的光谱信息优化全色特征。为克服频率融合不足,两个分支通过基于Mamba的跨模态调制交换信息,以线性复杂度显式建模这些解耦子带间的长程依赖。在WV3、GF2和QB数据集上,S2WMamba匹配或超越了近期强基线(FusionMamba、CANNet、U2Net、PanNet),在PSNR上提升最高0.23 dB,并在全分辨率WV3上达到HQNR 0.956。广泛的消融实验验证了模态特定DWT放置和并行双分支架构的有效性。
英文摘要:
Pansharpening fuses a high-resolution panchromatic (PAN) image with a low-resolution multispectral (LRMS) image to produce a high-resolution multispectral (HRMS) image. A key difficulty is that jointly processing PAN and MS features often entangles spatial detail enhancement with spectral fidelity. To address this feature entanglement, we propose S2WMamba, a framework that explicitly disentangles modality-specific frequency information for highly controlled crossmodal interaction. Concretely, unlike global frequency transforms, a localized 2D Haar DWT is applied to the PAN image to precisely isolate spatial edges and textures. Concurrently, a novel channel-wise 1D Haar DWT treats each pixel's spectrum as a 1D signal, isolating the shared spectral base from band-specific variations to strictly limit spectral distortion. The resulting Spectral branch injects wavelet-extracted spatial details into MS features, while the Spatial branch refines PAN features using spectra from the DWT1D process. To overcome inadequate frequency fusion, the two branches exchange information via Mambabased cross-modulation, which explicitly models long-range dependencies across these decoupled sub-bands with linear complexity. On WV3, GF2, and QB datasets, S2WMamba matches or surpasses recent strong baselines (FusionMamba, CANNet, U2Net, PanNet), improving PSNR by up to 0.23 dB and reaching an HQNR of 0.956 on full-resolution WV3. Extensive ablations justify the modality-specific DWT placement and the parallel dual-branch architecture.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。