Machine Learning Information Fusion in Earth Observation: A Comprehensive Review of Methods, Applications and Data Sources
Universidad de Alcalá(阿尔卡拉大学);Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心);Helmholtz Institute Freiberg for Resource Technology(亥姆霍兹弗赖贝格资源技术研究所);Universitat de València(瓦伦西亚大学);Technical University of Munich(慕尼黑工业大学);University of Natural Resources and Life Science (BOKU)(自然资源与生命科学大学(BOKU));Obuda University(奥布达大学);Oxford Brookes University(牛津布鲁克斯大学)
S. Salcedo-Sanz, P. Ghamisi, M. Piles, M. Werner, L. Cuadra, A. Moreno-Martínez, E. Izquierdo-Verdiguier, J. Muñoz-Marí, Amirhosein Mosavi, G. Camps-Valls
发表信息:
Information Fusion, Volume 63, November 2020, Pages 256-272
This paper reviews the most important information fusion data-driven algorithms based on Machine Learning (ML) techniques for problems in Earth observation. Nowadays we observe and model the Earth with a wealth of observations, from a plethora of different sensors, measuring states, fluxes, processes and variables, at unprecedented spatial and temporal resolutions. Earth observation is well equipped with remote sensing systems, mounted on satellites and airborne platforms, but it also involves in-situ observations, numerical models and social media data streams, among other data sources. Data-driven approaches, and ML techniques in particular, are the natural choice to extract significant information from this data deluge. This paper produces a thorough review of the latest work on information fusion for Earth observation, with a practical intention, not only focusing on describing the most relevant previous works in the field, but also the most important Earth observation applications where ML information fusion has obtained significant results. We also review some of the most currently used data sets, models and sources for Earth observation problems, describing their importance and how to obtain the data when needed. Finally, we illustrate the application of ML data fusion with a representative set of case studies, as well as we discuss and outlook the near future of the field.
Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey
School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);State Key Laboratory of Industrial Control Technology, Zhejiang University(浙江大学工业控制技术国家重点实验室);Hangzhou Dianzi University(杭州电子科技大学);Pillar of Information Systems Technology and Design, Singapore University of Technology and Design(新加坡科技设计大学信息系统技术与设计 pillar)
Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Review
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);Liaocheng University(聊城大学)
Bag of Visual Words and Fusion Methods for Action Recognition: Comprehensive Study and Good Practice
Southwest Jiaotong University(西南交通大学);The Chinese University of Hong Kong(香港中文大学);Nanyang Technological University(南洋理工大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
University of Liverpool(利物浦大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Institute of Deep Perception Technology, JITRI(江苏省产业技术研究院深度感知技术研究所);XJTLU-JITRI Academy of Industrial Technology(西交利物浦大学-江苏省产业技术研究院工业技术学院)
A comprehensive and trustworthy benchmark of AI methods for change detection in Earth observation
Bias Variance Labs, d.o.o.(Bias Variance Labs有限责任公司);University of Ljubljana(卢布尔雅那大学);Jožef Stefan Institute(约热夫·斯泰凡研究所);Télécom Paris(巴黎电信学院);Institut Polytechnique de Paris(巴黎综合理工学院)
SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining
Chair of Data Science in Earth Observation(地球观测数据科学主任);Technical University of Munich(慕尼黑技术大学);Remote Sensing Technology Institute(遥感技术研究所);German Aerospace Center (DLR)(德国航空航天中心);Department of Aerospace Engineering(航空航天工程系);University of the Bundeswehr Munich(联邦国防军慕尼黑大学);LEAP;Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);Inria(法国国家信息与自动化技术研究院);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔INP);LJK
A Survey of Deep Learning Based Radar and Vision Fusion for 3D Object Detection in Autonomous Driving
School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Electronic and Information Engineering, Suzhou University of Science and Technology(苏州科技大学电子与信息工程学院)
A Comprehensive Review of Techniques, Algorithms, Advancements, Challenges, and Clinical Applications of Multi-modal Medical Image Fusion for Improved Diagnosis
Interdisciplinary Research Center for Finance and Digital Economy, King Fahd University of Petroleum and Minerals(金融与数字经济交叉研究中心,国王法赫德石油和矿物大学);Department of Software Engineering, Faculty of Information Technology, Al-Ahliyya Amman University(软件工程系,信息科技学院,阿尔阿赫利亚大学);Department of Information Systems and Operations Management, King Fahd University of Petroleum and Minerals(信息系统与运营管理系,国王法赫德石油和矿物大学);ADAPT Research Centre, School of Computer Science, University of Galway(ADAPT研究中心,计算机科学学院,Galway大学);Department of Mechanical and Nuclear Engineering, Khalifa University(机械与核工程系,哈利法大学)
Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer
SenseTime Research(商汤科技研究院);University of Toronto(多伦多大学);The Chinese University of Hong Kong(香港中文大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Advancing Multinational License Plate Recognition Through Synthetic and Real Data Fusion: A Comprehensive Evaluation
Pontifical Catholic University of Paraná (PUCPR), Curitiba, Brazil;Federal University of Paran\'a (UFPR), Curitiba, Brazil;Federal Institute of Paran\'a (IFPR), Irati, Brazil;Federal University of Ouro Preto (UFOP), Ouro Preto, Brazil;Federal University of Technology-Paran\' a (UTFPR), Curitiba, Brazil
Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks
Université Paris Diderot, Sorbonne Paris Cité, Laboratoire Matière et Systèmes Complexes (MSC), UMR 7057 CNRS(巴黎狄德罗大学,索邦巴黎西岱大学,复杂物质与系统实验室(MSC),CNRS UMR 7057)
Multimodal Information Fusion for Chart Understanding: A Survey of MLLMs -- Evolution, Limitations, and Cognitive Enhancement
College of Computer Science, Sichuan University(四川大学计算机科学学院);Engineering Research Center of Machine Learning(机器学习工程研究中心);China Telecom Institute of AI(中国电信人工智能研究院)
S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion
Sino-UK Joint Laboratory on Artificial Intelligence of Ministry of Science and Technology(科技部中英联合人工智能实验室);International Joint Laboratory on Artificial Intelligence of Ministry of Education(教育部国际人工智能联合实验室);School of Artificial Intelligence and Computer Science(人工智能与计算机科学学院);College of Computer Science and Technology(计算机科学与技术学院)
YOLOv11-RGBT: Towards a Comprehensive Single-Stage Multispectral Object Detection Framework
School of Instrument Science and Opto-electronics Engineering, Anhui Province Key Laboratory of Measuring Theory and Precision Instrument(仪器科学与光电工程学院、安徽省测量理论与精密仪器重点实验室);Hefei University of Technology(合肥工业大学);School of Information Engineering(信息工程学院);Engineering University of PAP(工程大学)
Handcrafted vs. Deep Radiomics vs. Fusion vs. Deep Learning: A Comprehensive Review of Machine Learning -Based Cancer Outcome Prediction in PET and SPECT Imaging
BC Cancer Research Institute(BC癌症研究所);University of British Columbia(不列颠哥伦比亚大学);Technological Virtual Collaboration (TECVICO Corp.)(技术虚拟协作公司(TECVICO公司));Breast Cancer Research Center, Motamed Cancer Institute, ACECR(乳腺癌研究中心,莫塔梅德癌症研究所,学术教育科研中心);Sharif University of Technology(谢里夫理工大学);Guilan University of Medical Sciences(吉兰医科大学);University of Tehran(德黑兰大学);University of Iowa Carver College of Medicine(爱荷华大学卡佛医学院)
Institute of Computing Technology Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Capital Medical University(首都医科大学)
Hyperspectral and multispectral image fusion under spectrally varying spatial blurs -- Application to high dimensional infrared astronomical imaging
University of Toulouse(图卢兹大学);IRIT/INP-ENSEEIHT(图卢兹计算机研究所/国立图卢兹应用科学学院-国立高等电力技术、电子学、计算机、水力学与电信学院);CNRS(法国国家科学研究中心);Institut Universitaire de France (IUF)(法国大学研究院);ISAE-SUPAERO(法国高等航空航天学院);Institut de Recherche en Astrophysique et Planétologie (IRAP)(天体物理与行星学研究所)