arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.08920eess.IVcs.CVcs.NAmath.NA

W-DUALMINE:基于残差相关性保持的可靠性加权双专家融合用于医学图像融合

W-DUALMINE: Reliability-Weighted Dual-Expert Fusion With Residual Correlation Preservation for Medical Image Fusion

Department of Electrical and Electronic Engineering(电气与电子工程系)

Md. Jahidul Islam

AI总结:

W-DUALMINE通过可靠性加权双专家融合策略,解决医学图像融合中全局相关性与局部结构保真的权衡问题,提升融合效果。

摘要:

医学图像融合通过整合多种成像模态的互补信息来提高临床解释。然而,现有的基于深度学习的方法,包括最近的空域-频域框架如AdaFuse和ASFE-Fusion,常常在全局统计相似性(通过相关系数(CC)和互信息(MI)测量)和局部结构保真度之间存在根本性的权衡。本文提出了W-DUALMINE,一种可靠性加权双专家融合框架,旨在通过架构约束和理论基础的损失设计显式解决这一权衡。所提出的方法引入了密集可靠性图用于自适应模态加权,一种结合全局上下文空间专家和小波域频率专家的双专家融合策略,以及一种软梯度基于仲裁机制。此外,我们采用残差到平均融合范式,以保证全局相关性的保持同时增强局部细节。在CT-MRI、PET-MRI和SPECT-MRI数据集上的广泛实验表明,W-DUALMINE在CC和MI指标上始终优于AdaFuse和ASFE-Fusion

英文摘要:

Medical image fusion integrates complementary information from multiple imaging modalities to improve clinical interpretation. However, existing deep learningbased methods, including recent spatial-frequency frameworks such as AdaFuse and ASFE-Fusion, often suffer from a fundamental trade-off between global statistical similaritymeasured by correlation coefficient (CC) and mutual information (MI)and local structural fidelity. This paper proposes W-DUALMINE, a reliability-weighted dual-expert fusion framework designed to explicitly resolve this trade-off through architectural constraints and a theoretically grounded loss design. The proposed method introduces dense reliability maps for adaptive modality weighting, a dual-expert fusion strategy combining a global-context spatial expert and a wavelet-domain frequency expert, and a soft gradient-based arbitration mechanism. Furthermore, we employ a residual-to-average fusion paradigm that guarantees the preservation of global correlation while enhancing local details. Extensive experiments on CT-MRI, PET-MRI, and SPECT-MRI datasets demonstrate that W-DUALMINE consistently outperforms AdaFuse and ASFE-Fusion in CC and MI metrics while

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑