arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1804.06992cs.CV
收藏

基于深度学习框架的红外和可见光图像融合

Infrared and Visible Image Fusion using a Deep Learning Framework

Jiangnan University(江南大学);University of Surrey(萨里大学)

Hui Li, Xiao-Jun Wu, Josef Kittler

摘要:

近年来,深度学习已经成为一种非常活跃的研究工具,被应用于许多图像处理领域。在本文中,我们提出了一种有效的图像融合方法,该方法使用深度学习框架来生成包含红外和可见光图像的所有特征的单个图像。首先,将源图像分解为基本部分和细节内容。然后,通过加权平均融合的基础部分。对于细节内容,我们使用深度学习网络来提取多层特征。利用这些特征,我们使用l_1范数和加权平均策略来产生融合细节内容的多个候选。一旦我们得到这些候选者,最大选择策略被用来获得最终的融合细节内容。最后,将融合后的基本部分与细节部分相结合,重构融合图像。实验结果表明,我们提出的方法达到了国家的最先进的性能,在客观评价和视觉质量。我们的融合方法的代码可在https://github.com/hli1221/imagefusion_deeplearning上获得

英文摘要:

In recent years, deep learning has become a very active research tool which is used in many image processing fields. In this paper, we propose an effective image fusion method using a deep learning framework to generate a single image which contains all the features from infrared and visible images. First, the source images are decomposed into base parts and detail content. Then the base parts are fused by weighted-averaging. For the detail content, we use a deep learning network to extract multi-layer features. Using these features, we use l_1-norm and weighted-average strategy to generate several candidates of the fused detail content. Once we get these candidates, the max selection strategy is used to get final fused detail content. Finally, the fused image will be reconstructed by combining the fused base part and detail content. The experimental results demonstrate that our proposed method achieves state-of-the-art performance in both objective assessment and visual quality. The Code of our fusion method is available at https://github.com/hli1221/imagefusion_deeplearning

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑