Recent advancements in Multimodal Large Language Models (MLLMs) have enabled complex reasoning. However, existing remote sensing (RS) benchmarks remain heavily biased toward perception tasks, such as object recognition and scene classification. This limitation hinders the development of MLLMs for cognitively demanding RS applications. To address this, we propose a Vision Language ReaSoning Benchmark (VLRS-Bench), which is the first benchmark exclusively dedicated to complex RS reasoning. Structured across the three core dimensions of Cognition, Decision, and Prediction, VLRS-Bench comprises 2,000 question-answer pairs with an average question length of 129.87 words, spanning 14 tasks and up to eight temporal phases. VLRS-Bench is constructed via a specialized pipeline that integrates RS-specific priors and expert knowledge to ensure geospatial realism and reasoning complexity. Experimental results reveal significant bottlenecks in existing state-of-the-art MLLMs, providing critical insights for advancing multimodal reasoning within the remote sensing community.
LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretation
School of Computer Science, China University of Geosciences(中国地质大学(北京)计算机学院);PRADA Lab, King Abdullah University of Science and Technology(科廷大学PRADA实验室);Department of Computer Science, University of Exeter(埃克塞特大学计算机科学系)
RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation
Laboratory of Intelligent Language Processing, National University of Defense Technology(国防科技大学智能语言处理实验室);Hefei University of Technology(合肥工业大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院);United Arab Emirates University(阿联酋大学)
XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?
College of Computer Science and Technology, National University of Defense Technology(国防科技大学计算机学院);Tsinghua University(清华大学);Beijing University of Posts and Telecommunications(北京邮电大学);School of Computer Science, Wuhan University(武汉大学计算机学院);Zhongguancun Academy(中关村学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院)
Beyond Pixels: A Training-Free, Text-to-Text Framework for Remote Sensing Image Retrieval
Information Technology University of Technology Sydney Sydney, Australia(信息科技技术大学悉尼分校悉尼澳大利亚);Robotics Laboratory (SensR Lab) Centre for Advanced Manufacturing Technology Western Sydney University Sydney, Australia(机器人实验室(SensR实验室)先进制造技术中心西悉尼大学悉尼澳大利亚);The Data Science Institute Faculty of Engineering(数据科学学院工程学院)
College of Computer Science and Technology, National University of Defense Technology(国防科技大学计算机科学与技术学院);School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院)
GeoEyes: On-Demand Visual Focusing for Evidence-Grounded Understanding of Ultra-High-Resolution Remote Sensing Imagery
National University of Defense Technology, China(国防科技大学);Beijing University of Posts and Telecommunications, China(北京邮电大学);University of the Chinese Academy of Sciences, China(中国科学院大学);Shanghai Jiao Tong University, China(上海交通大学);Wuhan University, China(武汉大学);Chinese Academy of Science, China(中国科学院);Tsinghua University, China(清华大学);Renmin University of China, China(中国人民大学)
SEMT: Static-Expansion-Mesh Transformer Network Architecture for Remote Sensing Image Captioning
Austrian Institute of Technology(奥地利技术研究院);University of Technology of Troyes(图卢兹技术大学);Ho Chi Minh University of Technology(胡志明技术大学);Ton Duc Thang University(-ton Duc Thang大学)
OptiSAR-Net++: A Large-Scale Benchmark and Transformer-Free Framework for Cross-Domain Remote Sensing Visual Grounding
South China Normal University(华南师范大学);Hong Kong University of Science and Technology(香港科技大学);Tongji University(同济大学);Shanghai Research Institute for Intelligent Autonomous Systems(上海自主智能无人系统科学中心);State Key Laboratory of Intelligent Autonomous Systems(智能自主系统国家重点实验室);Frontiers Science Center for Intelligent Autonomous Systems(智能自主系统前沿科学中心)
A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(西北工业大学人工智能、光学与电子学院(iOPEN));Northwest Institute of Nuclear Technology(西北核技术研究所)
RSGPT: A Remote Sensing Vision Language Model and Benchmark
DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);New York University Abu Dhabi(纽约大学阿布扎比分校);University of Chinese Academy of Sciences(中国科学院大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学)
MonoIR-RS: Infrared Remote Sensing Vision-Language Learning with CLIP and VLM Adaptation
China University of Petroleum-Beijing at Karamay(中国石油大学(北京)克拉玛依校区);Guizhou University(贵州大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);Shanghai Jiao Tong University(上海交通大学)
RSVLM-QA: A Benchmark Dataset for Remote Sensing Vision Language Model-based Question Answering
School of Computer Science, University of Technology Sydney(技术悉尼大学计算机科学学院);SEDE, University of Technology Sydney(技术悉尼大学SEDE);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensing
RIKEN AIP(日本理化学研究所革新智能研究中心);Wuhan University(武汉大学);Linköping University(林雪平大学);University of Tokyo(东京大学);Nanjing University of Information Science and Technology(南京信息工程大学)
DescribeEarth: Describe Anything for Remote Sensing Images
School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);College of Artificial Intelligence, Xi’an Jiaotong University(西安交通大学人工智能学院);School of Computer Science and Technology and Ministry of Education Key Lab For Intelligent Networks and Network Security, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院和教育部智能网络与网络安全重点实验室);School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University(西安交通大学数学与统计学院和教育部智能网络与网络安全重点实验室);Pazhou Laboratory (Huangpu), Guangzhou, Guangdong, China(琶洲实验室(黄埔),广州,广东,中国)
MineAgent: Towards Remote-Sensing Mineral Exploration with Multimodal Large Language Models
Australian Artificial Intelligence Institute, University of Technology Sydney(悉尼科技大学澳大利亚人工智能研究所);Faculty of Science and Engineering, Curtin University(科廷大学科学与工程学院)
InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognition
Aerospace Information Research Institute, Chinese Academy of Sciences(航天信息研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Harbin Institute of Technology(哈尔滨工业大学);Shanghai Jiao Tong University(上海交通大学);University of Wollongong(沃林戈大学);SAIS, Shanghai Jiao Tong University(上海交通大学国际关系学院)
Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
Research & Development Institute of Northwestern Polytechnical University in Shenzhen(西北工业大学深圳研究院);School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Computer Science, Wuhan University(武汉大学计算机学院)
RS3DBench: A Comprehensive Benchmark for 3D Spatial Perception in Remote Sensing
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Software College of Zhejiang University(浙江大学软件学院);Hangzhou City University(杭州市大学)
Towards Efficient Benchmarking of Foundation Models in Remote Sensing: A Capabilities Encoding Approach
IRISA, Université Bretagne Sud, UMR 6074(IRISA,布列塔尼大学,UMR 6074);Centre National d’Études Spatiales (CNES)(国家空间科学研究中心(CNES));UiT The Arctic University of Norway(挪威北极大学)
Generalized Few-Shot Semantic Segmentation in Remote Sensing: Challenge and Benchmark
RIKEN Center for Advanced Intelligence Project (AIP)(理化学研究所先进智能项目中心);the University of Tokyo(东京大学);Ontario Tech University(安大略理工大学);University of British Columbia(不列颠哥伦比亚大学)