In recent years, deep learning has become a very active research tool which is used in many image processing fields. In this paper, we propose an effective image fusion method using a deep learning framework to generate a single image which contains all the features from infrared and visible images. First, the source images are decomposed into base parts and detail content. Then the base parts are fused by weighted-averaging. For the detail content, we use a deep learning network to extract multi-layer features. Using these features, we use l_1-norm and weighted-average strategy to generate several candidates of the fused detail content. Once we get these candidates, the max selection strategy is used to get final fused detail content. Finally, the fused image will be reconstructed by combining the fused base part and detail content. The experimental results demonstrate that our proposed method achieves state-of-the-art performance in both objective assessment and visual quality. The Code of our fusion method is available at https://github.com/hli1221/imagefusion_deeplearning
SFDFusion: An Efficient Spatial-Frequency Domain Fusion Network for Infrared and Visible Image Fusion
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院)
FusionRegister: Every Infrared and Visible Image Fusion Deserves Registration
School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China(江南大学人工智能与计算机科学学院);School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou, China(苏州科技大学电子与信息工程学院)
CoMoFusion: Fast and High-quality Fusion of Infrared and Visible Image with Consistency Model
School of Artificial Intelligence and Computer Science, Jiangnan University(江南大学人工智能与计算机科学学院);School of Electronic and Information Engineering, Suzhou University of Science and Technology(苏州科技大学电子与信息工程学院);College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息科学与电子工程学院)
针对生成式红外与可见光图像融合训练不稳、推理慢的问题,提出 CoMoFusion,利用一致性模型在潜空间建模多模态特征并结合像素值选择损失,实现快速高质量融合,达到 SOTA 性能。
A Symmetric Encoder-Decoder with Residual Block for Infrared and Visible Image Fusion
Sichuan University(四川大学);University of British Columbia(不列颠哥伦比亚大学);Xidian University(西安电子科技大学);Incheon National University(仁川大学);Shandong University of Technology(山东理工大学)
MSGFusion: Multimodal Scene Graph-Guided Infrared and Visible Image Fusion
College of Computer Science and Technology, Ocean University of China(中国海洋大学计算机科学与技术学院);College of Electronic Engineering, Ocean University of China(中国海洋大学电子工程学院)
EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusion
College of Information Engineering, Zhejiang University of Technology(浙江工业大学信息工程学院);College of Information Science and Technology, Zhejiang Shuren University(浙江树人大学信息科技学院);Department of Electrical and Electronic Engineering, The University of Hong Kong(香港大学电机电子工程系)
UMCFuse: A Unified Multiple Complex Scenes Infrared and Visible Image Fusion Framework
Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, School of Physics and Optoelectronic Engineering, Foshan University(广东-香港-澳门联合智能微纳光电技术实验室,物理与光电工程学院,佛山大学);School of Engineering, Hong Kong University of Science and Technology(工程学院,香港科学与技术大学);School of Information Engineering and Automation, Kunming University of Science and Technology(信息工程与自动化学院,昆明理工大学);School of Mechanical Electronic and Information Engineering, China University of Mining and Technology(机械电子与信息工程学院,中国矿业大学)
Infrared and Visible Image Fusion Based on Implicit Neural Representations
College of Computer Science, Beijing Information Science and Technology University(北京信息科技大学计算机学院);School of Mathematical Sciences, Capital Normal University(首都师范大学数学学院)
Fusion or Confusion? Assessing the impact of visible-thermal image fusion for automated wildlife detection
Department of Applied Geomatics, Université de Sherbrooke(舍布鲁克大学应用地理信息学系);Quebec Centre for Biodiversity Science, McGill University(麦吉尔大学魁北克生物多样性科学中心);Ministère de l’Environnement, de la Lutte contre les Changements Climatiques, de la Faune et des Parcs (MELCCFP)(魁北克省环境、气候变化、野生动物和公园部);Centre d'enseignement et de recherche en foresterie de Sainte-Foy(圣福瓦林业教学与研究中心)
Infrared and Visible Image Fusion with Hierarchical Human Perception
School of Electronic Engineering, Xidian University(西安电子科技大学电子工程学院);Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications(重庆邮电大学图像认知重点实验室)
SSPFusion: A Semantic Structure-Preserving Approach for Infrared and Visible Image Fusion
School of Software Engineering, Beijing Jiaotong University(北京交通大学软件工程学院);School of Astronautics, Beihang University(北航航天学院);Faculty of Engineering and Information Technology, University of Melbourne(墨尔本大学工程与信息技术学院);Ordos Laboratory, Ordos(鄂尔多斯实验室)
Bridging Human Evaluation to Infrared and Visible Image Fusion
School of Mechanical Engineering, Dalian University of Technology(大连理工大学机械工程学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);School of Software Technology & DUT-RU International School of ISE, Dalian University of Technology(大连理工大学软件学院);College of Information Science and Technology, Dalian Maritime University(大连海事大学信息科学与技术学院)
FusionCounting: Robust visible-infrared image fusion guided by crowd counting via multi-task learning
School of Information Science and Engineering, Yanshan University(燕山大学信息科学与工程学院);Fusion Intelligence Laboratory, Department of Computer Science, University of Exeter(埃克塞特大学计算机科学系融合智能实验室)
GrFormer: A Novel Transformer on Grassmann Manifold for Infrared and Visible Image Fusion
School of Artificial Intelligence(人工智能学院);Computer Science, Jiangnan University(计算机科学,江南大学);The Centre for Vision, Speech(视觉、语音与信号处理中心);Signal Processing, University of Surrey(信号处理,萨里大学)
Direction-aware multi-scale gradient loss for infrared and visible image fusion
Key Laboratory of Opto-Electronic Information Processing, Chinese Academy of Sciences(光电信息处理重点实验室,中国科学院);Shenyang Institute of Automation, Chinese Academy of Sciences(沈阳自动化研究所,中国科学院);University of Chinese Academy of Sciences, Chinese Academy of Sciences(中国科学院大学)