Archetypal scenarios for change detection generally consider two images acquired through sensors of the same modality. However, in some specific cases such as emergency situations, the only images available may be those acquired through different kinds of sensors. More precisely, this paper addresses the problem of detecting changes between two multi-band optical images characterized by different spatial and spectral resolutions. This sensor dissimilarity introduces additional issues in the context of operational change detection. To alleviate these issues, classical change detection methods are applied after independent preprocessing steps (e.g., resampling) used to get the same spatial and spectral resolutions for the pair of observed images. Nevertheless, these preprocessing steps tend to throw away relevant information. Conversely, in this paper, we propose a method that more effectively uses the available information by modeling the two observed images as spatial and spectral versions of two (unobserved) latent images characterized by the same high spatial and high spectral resolutions. As they cover the same scene, these latent images are expected to be globally similar except for possible changes in sparse spatial locations. Thus, the change detection task is envisioned through a robust multi-band image fusion method which enforces the differences between the estimated latent images to be spatially sparse. This robust fusion problem is formulated as an inverse problem which is iteratively solved using an efficient block-coordinate descent algorithm. The proposed method is applied to real panchormatic/multispectral and hyperspectral images with simulated realistic changes. A comparison with state-of-the-art change detection methods evidences the accuracy of the proposed strategy.
LMFNet: An Efficient Multimodal Fusion Approach for Semantic Segmentation in High-Resolution Remote Sensing
State Key Laboratory of information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(武汉大学测绘遥感信息工程国家重点实验室);Electronic Information School, Wuhan University(武汉大学电子信息学院)
提出了一种多波段遥感图像的贝叶斯融合方法。所观察到的图像与要通过物理退化恢复的高光谱和高空间分辨率图像相关,由传感器特性定义的空间和光谱模糊和/或子采样。在贝叶斯估计框架内制定的融合问题。一个适当的先验分布,利用几何考虑。为了从感兴趣场景的后验分布计算其贝叶斯估计,设计了马尔可夫链蒙特卡罗算法来根据目标分布生成渐近分布的样本。为了有效地从这种高维分布中采样,在Gibbs采样策略中引入了Hamilton Monte Carlo步骤。相对于几个国家的最先进的融合技术,所提出的融合方法的效率进行评估。特别地,低空间分辨率的高光谱和多光谱图像被融合以产生高空间分辨率的高光谱图像。
Data fusion of satellite imagery for generation of daily cloud free images at high resolution level
National University of Water and Environmental Engineering(国立水利与环境工程大学);EOS Data Analytics Ukraine(乌克兰EOS数据分析公司);Oles Honchar Dnipro National University(奥列西·贡恰尔第聂伯国立大学)
FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolution
School of Computer Science and Engineering, South China University of Technology(华南理工大学计算机科学与工程学院);School of Physics and Optoelectronic Engineering, Foshan University(佛山大学物理与光电工程学院);School of Instrumentation Science and Optelectronics Engineering, Beihang University(北航仪器科学与光电工程学院);School of Information Engineering and Automation, Kunming University of Science and Technology(昆明理工大学信息工程与自动化学院)
PFT-SSR: Parallax Fusion Transformer for Stereo Image Super-Resolution
The Chinese University of Hong Kong(香港中文大学);Shanghai University(上海大学);Jiangsu Key Laboratory of Image and Video Understanding for Social Safety(江苏省社会安全图像与视频理解重点实验室);Nanjing University of Posts and Telecommunications(南京邮电大学);East China Normal University(华东师范大学)
Physics Driven Deep Retinex Fusion for Adaptive Infrared and Visible Image Fusion
Wuxi University(无锡学院);HorizonFlow Laboratory(HorizonFlow实验室);Jiangnan University(江南大学);Three Gorges University(三峡大学);Boston University(波士顿大学);Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences(中国科学院上海光学精密机械研究所);Shanghai University of Electric Power(上海电力大学);Nanjing Agricultural University(南京农业大学)
Deep Fusion Prior for Plenoptic Super-Resolution All-in-Focus Imaging
Jiangnan University(江南大学);HorizonFlow Laboratory(HorizonFlow实验室);Chongqing Three Gorges University(重庆三峡大学);Boston University(波士顿大学);Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences(中国科学院上海光学精密机械研究所);OptiX+ Laboratory(OptiX+实验室)
Semi-Coupled Two-Stream Fusion ConvNets for Action Recognition at Extremely Low Resolutions
Boston University(波士顿大学)
深度卷积神经网络(ConvNets)最近被证明在标准分辨率视频的动作识别方面具有最先进的性能。然而,很少关注极低分辨率(eLR)下的识别性能(例如,16 x 12像素)。使用eLR相机的可靠动作识别将解决各种应用环境中的隐私问题,如私人住宅,医院,护理/康复设施等。在本文中,我们提出了一个半耦合滤波器共享网络,利用高分辨率(HR)视频在训练过程中,以协助eLR ConvNet。我们还研究了融合为eLR视频定制的空间和时间ConvNets的方法,以利用外观和运动信息。我们的方法在IXMAS(93.7%)和HMDB(29.2%)数据集上的极低分辨率下优于最先进的方法。
R-FUSE: Robust Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
University of Cambridge(剑桥大学);University of Toulouse(图卢兹大学);Instituto de Telecomunicações(电信研究所);Instituto Superior Técnico(高等技术学院);Universidade de Lisboa(里斯本大学)
Single MR Image Super-Resolution via Channel Splitting and Serial Fusion Network
University of Electronic Science and Technology of China(电子科技大学);High Field Magnetic Resonance Brain Imaging Laboratory of Sichuan(四川省高场磁共振脑成像实验室);Key Laboratory for Neuro Information of Ministry of Education(神经信息教育部重点实验室)
Hyperspectral Image Fusion with Spectral-Band and Fusion-Scale Agnosticism
University of Electronic Science and Technology of China, School of Mathematical Sciences, Chengdu, China(电子科技大学数学学院);University of Electronic Science and Technology of China, Multi-Hazard Early Warning Key Laboratory of Sichuan Province, Chengdu, China(电子科技大学四川省多灾种早期预警重点实验室);University of Electronic Science and Technology of China, School of Computer Science and Engineering (School of Cyber Security), Chengdu, China(电子科技大学计算机科学与工程学院(网络安全学院))
Hyperspectral and multispectral image fusion with arbitrary resolution through self-supervised representations
Southern University of Science and Technology(南方科技大学);The Chinese University of Hong Kong(香港中文大学);University of Electronic Science and Technology of China(电子科技大学);Hong Kong Baptist University(香港浸会大学)
Band Prompting Aided SAR and Multi-Spectral Data Fusion Framework for Local Climate Zone Classification
College of Computer Science and Technology, Harbin Engineering University(哈尔滨工程大学计算机科学与技术学院);School of Astronautics, Beihang University(北京航空航天大学宇航学院);School of Software, Dalian University of Technology(大连理工大学软件学院);State Key Laboratory of Space-Ground Integrated Information Technology(天地一体化信息技术国家重点实验室)