Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Models
Nanjing University(南京大学);Xiaohongshu Inc.(小红书公司);East China Normal University(华东师范大学);The Chinese University of Hong Kong(香港中文大学);Shanghai Jiao Tong University(上海交通大学);University of Oxford(牛津大学)
Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved 2D visual understanding, prompting interest in their application to complex 3D reasoning tasks. However, it remains unclear whether these models can effectively capture the detailed spatial information required for robust real-world performance, especially cross-view consistency, a key requirement for accurate 3D reasoning. Considering this issue, we introduce Viewpoint Learning, a task designed to evaluate and improve the spatial reasoning capabilities of MLLMs. We present the Viewpoint-100K dataset, consisting of 100K object-centric image pairs with diverse viewpoints and corresponding question-answer pairs. Our approach employs a two-stage fine-tuning strategy: first, foundational knowledge is injected to the baseline MLLM via Supervised Fine-Tuning (SFT) on Viewpoint-100K, resulting in significant improvements across multiple tasks; second, generalization is enhanced through Reinforcement Learning using the Group Relative Policy Optimization (GRPO) algorithm on a broader set of questions. Additionally, we introduce a hybrid cold-start initialization method designed to simultaneously learn viewpoint representations and maintain coherent reasoning thinking. Experimental results show that our approach significantly activates the spatial reasoning ability of MLLM, improving performance on both in-domain and out-of-domain reasoning tasks. Our findings highlight the value of developing foundational spatial skills in MLLMs, supporting future progress in robotics, autonomous systems, and 3D scene understanding.
Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
AMAP, Alibaba Group(阿里云实验室,阿里巴巴集团);University of Chinese Academy of Sciences(中国科学院大学);Tsinghua University(清华大学);Nanyang Technological University(南洋理工大学)
UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
University of Science and Technology of China(中国科学技术大学);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学);Zhongguancun Academy(中关村学院)
Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark
University of Electronic Science and Technology of China(电子科技大学);Sun Yat-sen University(中山大学);University of Washington(华盛顿大学);Microsoft(微软公司);The Chinese University of Hong Kong(香港中文大学)
本文提出覆盖数学、物理、化学和编程的 EMMA 多模态推理基准,揭示先进 MLLMs 在复杂跨模态、多步推理上仍存在明显不足。
Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do
The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所复杂系统认知与决策智能实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Reasoning Guided Embeddings: Leveraging MLLM Reasoning for Improved Multimodal Retrieval
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室);Sensetime Research(商汤科技研究院);Beijing Institute of Technology(北京理工大学);Shanghai AI Lab(上海人工智能实验室)
Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models
The Hong Kong Polytechnic University(香港理工大学);Zhejiang University(浙江大学);University of Electronic Science and Technology of China(电子科技大学);Reallm Labs(Reallm 实验室);Amazon(亚马逊);The Hong Kong University of Science and Technology(香港理工大学)
Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
Zhejiang University(浙江大学);Fudan University(复旦大学);Soochow University(苏州大学);Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensions
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing Future Brain Education Technology Co., Ltd.(北京未来脑教育科技有限公司);The Hong Kong University of Science and Technology(香港科技大学)
V-Retrver: Evidence-Driven Agentic Reasoning for Universal Multimodal Retrieval
Tsinghua University(清华大学);University of Central Florida(中央佛罗里达大学);Fudan University(复旦大学);The Australian National University(澳大利亚国立大学);The University of Hong Kong(香港大学);Pengcheng Laboratory(鹏城实验室);Central South University(中南大学)
Tsinghua University(清华大学);Meituan Inc(美团公司);Central South University(中南大学);Peking University(北京大学);University of Chinese Academy of Sciences(中国科学院大学);Nanyang Technological University(南洋理工大学)
Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models
School of Engineering, Westlake University(西湖大学工程学院);City University of Hong Kong(香港城市大学);Research Center for Industries of the Future, Westlake University(西湖大学未来产业研究中心);Johns Hopkins University(约翰斯·霍普金斯大学)
ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
National University of Singapore(新加坡国立大学);Zhejiang University(浙江大学);University of Washington(华盛顿大学);Stanford University(斯坦福大学);absolute AI;The Chinese University of Hong Kong(香港中文大学)
Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models
Harvard Medical School, Harvard University(哈佛医学院、哈佛大学);Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital(阿提尼乌拉A.马丁努斯生物医学成像中心、麻省总医院);Knovel Engineering Lab, Singapore(Knovel工程实验室、新加坡)
A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Nanyang Technological University(南洋理工大学);Squirrel Ai Learning(松鼠Ai学习)
EscapeCraft: A 3D Room Escape Environment for Benchmarking Complex Multimodal Reasoning Ability
Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China(计算机科学与技术系,人工智能研究院,清华大学,北京,中国);Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China(人工智能产业研究院(AIR),清华大学,北京,中国);School of Management, Fudan University, Shanghai, China(管理学院,复旦大学,上海,中国)
Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
HKUST(GZ)(香港科技大学(广州));HKUST(香港科技大学);South China University of Technology(华南理工大学);Shanghai Jiao Tong University(上海交通大学);University of Pisa(比萨大学);University of Trento(特伦托大学)
GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(基础模型研究中心,自动化研究所,中国科学院);ByteDance(字节跳动);School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);Peng Cheng Laboratory(鹏城实验室);Wuhan AI Research(武汉人工智能研究所);Xi’an Jiaotong University(西安交通大学);Renmin University of China(中国人民大学)