Detecting temporal changes in geographical landscapes is critical for applications like environmental monitoring and urban planning. While remote sensing data is abundant, existing vision-language models (VLMs) often fail to capture temporal dynamics effectively. This paper addresses these limitations by introducing an annotated dataset of video frame pairs to track evolving geographical patterns over time. Using fine-tuning techniques like Low-Rank Adaptation (LoRA), quantized LoRA (QLoRA), and model pruning on models such as Video-LLaVA and LLaVA-NeXT-Video, we significantly enhance VLM performance in processing remote sensing temporal changes. Results show significant improvements, with the best performance achieving a BERT score of 0.864 and ROUGE-1 score of 0.576, demonstrating superior accuracy in describing land-use transformations.
GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution
College of Computer Science and Technology, National University of Defense Technology, China(中国国防科技大学计算机科学与技术学院);Beijing University of Posts and Telecommunications, China(北京邮电大学);School of Computer Science, Wuhan University, China(武汉大学计算机学院);Zhongguancun Academy, China(中关村学院);Tsinghua University, China(清华大学);Beihang University, China(北航大学)
UniRS: Unifying Multi-temporal Remote Sensing Tasks through Vision Language Models
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(北京邮电大学);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);School of Geographic Sciences, Hunan Normal University(湖南师范大学);City University of Hong Kong(香港城市大学)
RS-MoE: A Vision-Language Model with Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering
China Academy of Electronics and Information Technology(中国电子科技集团公司电子科学研究院);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);Harbin Institute of Technology(哈尔滨工业大学);New York University Abu Dhabi(纽约大学阿布扎比分校)
RSHallu: Dual-Mode Hallucination Evaluation for Remote-Sensing Multimodal Large Language Models with Domain-Tailored Mitigation
College of Computer Science, Chongqing University(重庆大学计算机科学学院);Heavy Rainfall Research Center of China(中国强降水研究中心);CMA Key Open Laboratory of Transforming Climate Resources to Economy, Chongqing Institute of Meteorological Sciences(中国气象局气候资源转化经济重点开放实验室、重庆气象科学研究院);Chongqing Metropolitan College of Science(重庆科学理工学院);School of Intelligence Science(智能科学学院);College of Artificial Intelligence, Harbin Institute of Technology(人工智能学院、哈尔滨工业大学);BNU-UIC Institute of Artificial Intelligence(北京师范大学-国际学院人工智能与未来网络研究院);Future Networks, Beijing Normal University at Zhuhai(未来网络、北京师范大学珠海分校)
Enhancing Perception of Key Changes in Remote Sensing Image Change Captioning
National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University(武汉大学计算机学院国家多媒体软件工程技术研究中心);Hubei Luojia Laboratory(湖北珞珈实验室);School of Urban Design, Wuhan University(武汉大学城市设计学院);School of Remote Sensing and Information Engineering, Wuhan University(武汉大学遥感信息工程学院)
Deep learning-based interactive segmentation in remote sensing
National Center for Ecological Analysis and Synthesis, University of California, Santa Barbara(加州大学圣塔芭芭拉分校国家生态分析与综合中心);University of Idaho(爱达荷大学);Fujian Agriculture and Forestry University(福建农林大学);Bren School of Environmental Science and Management, University of California, Santa Barbara(加州大学圣塔芭芭拉分校布伦环境科学与管理学院)
SAM2-ELNet: Label Enhancement and Automatic Annotation for Remote Sensing Segmentation
College of Instrumentation and Electrical Engineering, Jilin University(吉林大学仪器电气工程学院);Key Laboratory of Geophysical Exploration Equipment, Ministry of Education(教育部地球物理探测装备重点实验室);School of Mathematics, Jilin University(吉林大学数学学院)
Large scale cross-regional remote sensing flood monitoring framework for operative mapping and impact analysis
Skolkovo Institute of Science and Technology(斯科尔科沃科学技术研究所);Trofimuk Institute of Petroleum Geology and Geophysics SB RAS(俄罗斯科学院西伯利亚分院特罗菲穆克石油天然气地质与地球物理研究所);King Fahd University of Petroleum and Minerals(法赫德国王石油与矿产大学);Tyumen Industrial University(秋明工业大学);Huawei Russian Research Institute(华为俄罗斯研究院)
GAIA: A Global, Multi-modal, Multi-scale Vision-Language Dataset for Remote Sensing Image Analysis
Orion Lab, School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens(奥里昂实验室,农村测绘与地理信息工程学院,希腊雅典国家技术大学);Institute of Astronomy, Astrophysics, Space Applications and Remote Sensing, National Observatory of Athens(天文、天体物理、空间应用与遥感研究所,希腊雅典国家天文台);Department of Informatics and Telematics, Harokopio University of Athens(信息与电信技术系,雅典霍罗科皮欧大学);Chair of Data Science in Earth Observation, Technical University of Munich(地球观测数据科学教授职位,慕尼黑技术大学);Munich Center for Machine Learning(慕尼黑机器学习中心);Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin(电气工程与计算机科学系,柏林技术大学);BIFOLD - Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究所)
Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval
School of Computer Science and Technology, Xi’an University of Posts and Telecommunications(西安邮电大学计算机科学与技术学院);Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing(陕西省网络数据分析与智能处理重点实验室);Xi’an Key Laboratory of Big Data and Intelligent Computing(西安大数据与智能计算重点实验室);School of Computer Engineering, Weifang University(潍坊大学计算机工程学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Department of Electronic and Electrical Engineering, Brunel University of London(伦敦布鲁内尔大学电子与电气工程系);Dept. Matemàtiques i Informàtica and Institute of Neuroscience, Univeritat de Barcelona(数学与计算机系和神经科学研究所,巴塞罗那大学)
SChanger: Change Detection from a Semantic Change and Spatial Consistency Perspective
School of Earth Sciences and Engineering, Hohai University(河海大学地球科学与工程学院);School of Geosciences and Info-physics, Central South University(中南大学地球科学与信息物理学院)