Fine-grained visual reasoning is essential for remote sensing in urban management, yet remains underexplored in the evaluation of multimodal large language models (MLLMs). We introduce UMBench, a fine-grained urban remote sensing benchmark built from unmanned aerial vehicle (UAV) images for multiple urban management tasks such as traffic monitoring, urban construction, environmental quality, and disaster warning. Evaluations on UMBench reveal that current MLLMs often rely on scene-level priors and overlook fine-grained visual evidence. To address this issue, we further propose a novel evidence-first chain-of-thought method that directs models to inspect fine-grained visual evidence in a training-free manner. Experiments show that our method can improve the performance of both open-source and commercial MLLMs on UMBench.
RoadBench: Benchmarking MLLMs on Fine-Grained Spatial Understanding and Reasoning under Urban Road Scenarios
Department of Electronic Engineering, BNRist, Tsinghua University(清华大学电子工程系、北京信息科学与技术国家研究中心);Zhongguancun Academy(中关村学院);Amap, Alibaba Group(阿里巴巴集团高德地图)
CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments
College of Systems Engineering, National University of Defense Technology(系统工程学院,国防科技大学);State Key Laboratory of Digital Intelligent Modeling and Simulation(数字智能建模与仿真国家重点实验室);BNRist, Tsinghua University(清华大学北京研究院);Department of Electronic Engineering, Tsinghua University(电子工程系,清华大学)
LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretation
School of Computer Science, China University of Geosciences(中国地质大学(北京)计算机学院);PRADA Lab, King Abdullah University of Science and Technology(科廷大学PRADA实验室);Department of Computer Science, University of Exeter(埃克塞特大学计算机科学系)
SEMT: Static-Expansion-Mesh Transformer Network Architecture for Remote Sensing Image Captioning
Austrian Institute of Technology(奥地利技术研究院);University of Technology of Troyes(图卢兹技术大学);Ho Chi Minh University of Technology(胡志明技术大学);Ton Duc Thang University(-ton Duc Thang大学)
Urban feature analysis from aerial remote sensing imagery using self-supervised and semi-supervised computer vision
The University of Melbourne(墨尔本大学);Royal Netherlands Meteorological Institute (KNMI)(荷兰皇家气象研究所);University of Melbourne(墨尔本大学);Environment Protection Authority Victoria(维多利亚州环境保护局)
L2RSI: Cross-view LiDAR-based Place Recognition for Large-scale Urban Scenes via Remote Sensing Imagery
Fujian Key Laboratory of Sensing and Computing for Smart Cities, Xiamen University, China(福建智能城市感知与计算重点实验室,厦门大学,中国);Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, China(多媒体可信感知与高效计算重点实验室,中华人民共和国教育部,厦门大学,中国);University of Science and Technology of China, China(中国科学技术大学,中国)
Think and Answer ME: Benchmarking and Exploring Multi-Entity Reasoning Grounding in Remote Sensing
Beihang University, Beijing, China(北京航空航天大学);University of Liverpool, Liverpool, UK(利物浦大学);Institute of Acoustics, Chinese Academy of Sciences, Beijing, China(中国科学院声学研究所)
UV-Mamba: A DCN-Enhanced State Space Model for Urban Village Boundary Identification in High-Resolution Remote Sensing Images
School of Computer Technology and Applications, Qinghai University(青海大学计算机技术与应用学院);School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
UP-Diff: Latent Diffusion Model for Remote Sensing Urban Prediction
Intelligent Science & Technology Academy of CASIC(中国航天科工集团智能科学与技术研究院);College of Information Science & Electronic Engineering, Zhejiang University(浙江大学信息科学与电子工程学院);School of Computer Science, Peking University(北京大学计算机学院);College of Engineering, Westlake University(西湖大学工学院)
Cross-Modal Urban Sensing: Evaluating Sound-Vision Alignment Across Street-Level and Aerial Imagery
Department of Geography, University of South Carolina(南卡罗来纳大学地理系);Department of Environmental Sciences, Emory University(埃默里大学环境科学系);University of Canterbury(坎特伯雷大学);School of Resource and Environmental Sciences, Wuhan University(武汉大学资源与环境科学学院)
UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery
Wuhan University(武汉大学);Key Laboratory of Natural Resources Monitoring in Tropical and Subtropical Area of South China, Ministry of Natural Resources(自然资源部华南热带亚热带自然资源监测重点实验室);Lancaster University(兰卡斯特大学);UK Centre for Ecology & Hydrology(英国生态与水文研究中心);University of Twente(特文特大学);University of Southampton(南安普顿大学);Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences(中国科学院地理科学与资源研究所)
Benchmarking Video Foundation Models for Remote Parkinson's Disease Screening
University of Rochester, Rochester, NY, USA(罗切斯特大学);Louisiana State University Health Sciences Center at Shreveport, USA(路易斯安那州立大学谢夫波特医学中心);University of Rochester Medical Center, Rochester, NY, USA(罗切斯特大学医学中心);University of Cambridge, Cambridge, UK(剑桥大学)
Research on the pixel-based and object-oriented methods of urban feature extraction with GF-2 remote-sensing images
East China Normal University(华东师范大学);Peter the Great St. Petersburg Polytechnic University(彼得大帝圣彼得堡理工大学);Institute of Technical Physics, Chinese Academy of Sciences(中国科学院上海技术物理研究所)
MVRD-Bench: Multi-View Learning and Benchmarking for Dynamic Remote Photoplethysmography under Occlusion
Nanjing University of Information Science and Technology(南京信息工程大学);University of Oulu(奥卢大学);Xi’an Jiaotong University(西安交通大学);Zhejiang University(浙江大学)
Towards Efficient Benchmarking of Foundation Models in Remote Sensing: A Capabilities Encoding Approach
IRISA, Université Bretagne Sud, UMR 6074(IRISA,布列塔尼大学,UMR 6074);Centre National d’Études Spatiales (CNES)(国家空间科学研究中心(CNES));UiT The Arctic University of Norway(挪威北极大学)
ASCoR: Asymmetric Semantic-Spatial Learning for Remote Sensing Domain Generalization
Beihang University(北京航空航天大学);University of Science and Technology Beijing(北京科技大学);University of Liverpool(利物浦大学);Guangdong Electronic Information Engineering Research Institute, University of Electronic Science and Technology of China(电子科技大学广东电子信息工程研究院)
SLUM-i: Semi-supervised Learning for Urban Mapping of Informal Settlements and Data Quality Benchmarking
School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST)(电气工程与计算机科学学院,国立科学与技术大学(NUST));Smart Data & Knowledge Services, German Research Center for Artificial Intelligence (DFKI)(智能数据与知识服务,德国人工智能研究中心(DFKI))
DB SwinT: A Dual-Branch Swin Transformer Network for Road Extraction in Optical Remote Sensing Imagery
School of Information Science and Engineering(信息科学与工程学院);Chongqing Jiaotong University(重庆交通大学);College of Information Engineering(信息工程学院);Inner Mongolia University of Technology(内蒙古科技大学);Inner Mongolia Key Laboratory of Radar Technology and Application(内蒙古雷达技术与应用重点实验室)