arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.11456cs.CV

耦合退化建模与融合:一种用于退化感知红外与可见光图像融合的VLM引导退化耦合网络

Coupled Degradation Modeling and Fusion: A VLM-Guided Degradation-Coupled Network for Degradation-Aware Infrared and Visible Image Fusion

Tianpei Zhang, Jufeng Zhao, Yiming Zhu, Guangmang Cui

AI总结:

针对退化图像导致融合性能下降的问题,提出VGDCFusion网络,通过VLM引导将退化建模与融合过程紧密耦合,实现退化感知与抑制,显著优于现有方法。

摘要:

现有的红外与可见光图像融合(IVIF)方法通常假设输入为高质量图像。然而,在处理退化图像时,这些方法严重依赖手动切换不同的预处理技术。这种退化处理与图像融合的解耦会导致性能显著下降。本文提出了一种新颖的VLM引导退化耦合融合网络(VGDCFusion),它将退化建模与融合过程紧密耦合,并利用视觉语言模型(VLMs)进行退化感知和引导抑制。具体而言,提出的特定提示退化耦合提取器(SPDCE)实现了模态特定的退化感知,并建立了退化抑制与模态内特征提取的联合建模。同时,联合提示退化耦合融合(JPDCF)促进了跨模态退化感知,并将残差退化滤波与互补的跨模态特征融合相耦合。大量实验表明,在各种退化图像场景下,我们的VGDCFusion显著优于现有的最先进融合方法。代码可在https://github.com/Lmmh058/VGDCFusion获取。

英文摘要:

Existing Infrared and Visible Image Fusion (IVIF) methods typically assume high-quality inputs. However, when handing degraded images, these methods heavily rely on manually switching between different pre-processing techniques. This decoupling of degradation handling and image fusion leads to significant performance degradation. In this paper, we propose a novel VLM-Guided Degradation-Coupled Fusion network (VGDCFusion), which tightly couples degradation modeling with the fusion process and leverages vision-language models (VLMs) for degradation-aware perception and guided suppression. Specifically, the proposed Specific-Prompt Degradation-Coupled Extractor (SPDCE) enables modality-specific degradation awareness and establishes a joint modeling of degradation suppression and intra-modal feature extraction. In parallel, the Joint-Prompt Degradation-Coupled Fusion (JPDCF) facilitates cross-modal degradation perception and couples residual degradation filtering with complementary cross-modal feature fusion. Extensive experiments demonstrate that our VGDCFusion significantly outperforms existing state-of-the-art fusion approaches under various degraded image scenarios. Our code is available at https://github.com/Lmmh058/VGDCFusion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑