大模型推理能力

Orion: A Unified Visual Agent for Multimodal Perception, Advanced Visual Reasoning and Execution

Orion：一个多模态感知、高级视觉推理与执行的统一视觉代理

N Dinesh Reddy, Dylan Snyder, Lona Kiragu, Mirajul Mohin, Shahrear Bin Amin, Sudeep Pillai

机构 * VLM Run Research（VLM Run研究） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

AI总结 Orion通过整合视觉推理与工具增强执行，实现了多模态感知、高级视觉推理与执行的统一，提升多步骤视觉智能性能。

MEXA: Towards General Multimodal Reasoning with Dynamic Multi-Expert Aggregation

Shoubin Yu, Yue Zhang, Ziyang Wang, Jaehong Yoon, Mohit Bansal

机构 * UNC Chapel Hill（北卡罗来纳大学教堂山分校） ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2025 Findings; The first two authors contributed equally; Github link: https://github.com/Yui010206/MEXA

Stuck in the Matrix: Probing Spatial Reasoning in Large Language Models

Maggie Bai, Ava Kim Cohen, Eleanor Koss, Charlie Lichtenbaum

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 20 pages, 24 figures

SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models

Hongxing Li, Dingming Li, Zixuan Wang, Yuchen Yan, Hang Wu, Wenqi Zhang, Yongliang Shen, Weiming Lu, Jun Xiao, Yueting Zhuang

机构 * Zhejiang University（浙江大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Project Page: https://zju-real.github.io/SpatialLadder/ Code: https://github.com/ZJU-REAL/SpatialLadder

Spatial-ViLT: Enhancing Visual Spatial Reasoning through Multi-Task Learning

Chashi Mahiul Islam, Oteo Mamo, Samuel Jacob Chacko, Xiuwen Liu, Weikuan Yu

机构 * Florida State University（佛罗里达州立大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 12 pages, 5 figures

Radiology's Last Exam (RadLE): Benchmarking Frontier Multimodal AI Against Human Experts and a Taxonomy of Visual Reasoning Errors in Radiology

Suvrankar Datta, Divya Buchireddygari, Lakshmi Vennela Chowdary Kaza, Mrudula Bhalke, Kautik Singh, Ayush Pandey, Sonit Sai Vasipalli, Upasana Karnwal, Hakikat Bir Singh Bhatti, Bhavya Ratan Maroo, Sanjana Hebbar, Rahul Joseph, Gurkawal Kaur, Devyani Singh, Akhil V, Dheeksha Devasya Shama Prasad, Nishtha Mahajan, Ayinaparthi Arisha, Rajesh Vanagundi, Reet Nandy, Kartik Vuthoo, Snigdhaa Rajvanshi, Nikhileswar Kondaveeti, Suyash Gunjal, Rishabh Jain, Rajat Jain, Anurag Agrawal

机构 * Centre for Responsible Autonomous Systems in Healthcare (CRASH) Lab, Koita Centre for Digital Health（负责任的自主医疗系统中心（CRASH）实验室、Koita数字健康中心） ； Ashoka University（阿什oka大学） ； Independent Researcher（独立研究者） ； Koita Centre for Digital Health（Koita数字健康中心） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 29 pages, 7 figures, 7 tables, includes Annexure (1). Part of the work accepted at RSNA 2025 (Cutting Edge Oral Presentation)

Interpretable Physics Reasoning and Performance Taxonomy in Vision-Language Models

Pranav Pawar, Kavish Shah, Akshat Bhalani, Komal Kasat, Dev Mittal, Hadi Gala, Deepali Patil, Nikita Raichada, Monali Deshmukh

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

11Plus-Bench: Demystifying Multimodal LLM Spatial Reasoning with Cognitive-Inspired Analysis

Chengzu Li, Wenshan Wu, Huanyu Zhang, Qingtao Li, Zeyu Gao, Yan Xia, José Hernández-Orallo, Ivan Vulić, Furu Wei

机构 * Microsoft Research（微软研究院） ； Language Technology Lab, University of Cambridge（语言技术实验室，剑桥大学） ； Institute of Automation, Chinese Academy of Sciences（自动化研究所，中国科学院） ； Department of Oncology, University of Cambridge（癌症部门，剑桥大学） ； Leverhulme Centre for the Future of Intelligence, University of Cambridge（未来智能中心，剑桥大学） ； VRAIN, Universitat Politècnica de València（VRAIN，巴塞罗那理工大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 4 figures (22 pages, 7 figures, 7 tables including references and appendices)

CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting

Atin Pothiraj, Elias Stengel-Eskin, Jaemin Cho, Mohit Bansal

机构 * UNC Chapel Hill（北卡罗来纳大学教堂山分校） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ICCV 2025

Can Large Language Models Integrate Spatial Data? Empirical Insights into Reasoning Strengths and Computational Weaknesses

Bin Han, Robert Wolfe, Anat Caspi, Bill Howe

机构 * University of Washington（华盛顿大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Reinforcing VLMs to Use Tools for Detailed Visual Reasoning Under Resource Constraints

Sunil Kumar, Bowen Zhao, Leo Dirac, Paulina Varshavskaya

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understanding

Jie Feng, Shengyuan Wang, Tianhui Liu, Yanxin Xi, Yong Li

机构 * Department of Electronic Engineering, BNRist, Tsinghua University, Beijing, China（电子工程系，北京理工大学，清华大学，北京，中国） ； Department of Computer Science and Technology, Tsinghua University, Beijing, China（计算机科学与技术系，清华大学，北京，中国） ； School of Electronic and Information Engineering, Beijing Jiaotong University, China（电子与信息工程学院，北京交通大学，中国） ； University of Helsinki, Finland（赫尔辛基大学，芬兰） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ICCV 2025

Reasoning Limitations of Multimodal Large Language Models. A Case Study of Bongard Problems

Mikołaj Małkiński, Szymon Pawlonka, Jacek Mańdziuk

机构 * Warsaw University of Technology, Warsaw, Poland（华沙技术大学） ； AGH University of Krakow, Krakow, Poland（克拉科夫AGH大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted to The Forty-Second International Conference on Machine Learning (ICML 2025)

Foundation Models for Geospatial Reasoning: Assessing Capabilities of Large Language Models in Understanding Geometries and Topological Spatial Relations

Yuhan Ji, Song Gao, Ying Nie, Ivan Majić, Krzysztof Janowicz

机构 * GeoDS Lab, Department of Geography, University of Wisconsin-Madison, USA（威斯康星大学麦迪逊分校地理系GeoDS实验室） ； Department of Geography and Regional Research, University of Vienna, Austria（维也纳大学地理与区域研究系） ； Department of Geography, University of California-Santa Barbara, USA（加州大学圣塔芭芭拉分校地理系） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 33 pages, 13 figures, IJGIS GeoFM Special Issue

Journal ref International Journal of Geographical Information Science, 2025 International Journal of Geographical Information Science International Journal of Geographical Information Science

SpatialPrompting: Keyframe-driven Zero-Shot Spatial Reasoning with Off-the-Shelf Multimodal Large Language Models

Shun Taguchi, Hideki Deguchi, Takumi Hamazaki, Hiroyuki Sakai

机构 * Toyota Central R&D Labs., Inc.（丰田中央研究实验室） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 18 pages, 11 figures

On Data Synthesis and Post-training for Visual Abstract Reasoning

Ke Zhu, Yu Wang, Jiangjiang Liu, Qunyi Xie, Shanshan Liu, Gang Zhang

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion

Shoubin Yu, Jaehong Yoon, Mohit Bansal

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ICLR 2025; first two authors contributed equally. Project page: https://CREMA-VideoLLM.github.io/

R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model

Hengguang Zhou, Xirui Li, Ruochen Wang, Minhao Cheng, Tianyi Zhou, Cho-Jui Hsieh

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 6 figures

ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigation

Abrar Anwar, John Welsh, Joydeep Biswas, Soha Pouya, Yan Chang

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models

Gengze Zhou, Yicong Hong, Zun Wang, Xin Eric Wang, Qi Wu

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to ECCV 2024

GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understanding

Yibo Yan, Joey Lee

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted by International Conference on Information and Knowledge Management 2024

MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains

Zhaohuan Zhan, Lisha Yu, Sijie Yu, Guang Tan

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling

Haider Al-Tahan, Quentin Garrido, Randall Balestriero, Diane Bouchacourt, Caner Hazirbas, Mark Ibrahim

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

ConTextual: Evaluating Context-Sensitive Text-Rich Visual Reasoning in Large Multimodal Models

Rohan Wadhawan, Hritik Bansal, Kai-Wei Chang, Nanyun Peng

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Journal ref PMLR 235:49733-49787, 2024

Can Large Language Models Create New Knowledge for Spatial Reasoning Tasks?

Thomas Greatrix, Roger Whitaker, Liam Turner, Walter Colombo

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Towards Truly Zero-shot Compositional Visual Reasoning with LLMs as Programmers

Aleksandar Stanić, Sergi Caelles, Michael Tschannen

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation

Xiwen Liang, Liang Ma, Shanshan Guo, Jianhua Han, Hang Xu, Shikui Ma, Xiaodan Liang

专题命中 视觉空间推理 ：planning(title,abstract)；分类 cs.CL、cs.AI

Comments 22 pages

Learning Abstract Visual Reasoning via Task Decomposition: A Case Study in Raven Progressive Matrices

Jakub Kwiatkowski, Krzysztof Krawiec

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 22 pages, 10 figures

Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models

Navid Rajabi, Jana Kosecka

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to DMLR @ ICLR 2024

LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations

Yudong Xu, Wenhao Li, Pashootan Vaezipoor, Scott Sanner, Elias B. Khalil

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 26 pages, 15 figures, published in Transactions on Machine Learning Research (TMLR)