Long-horizon robot planning requires jointly reasoning over semantic task structure and geometric feasibility. To successfully execute a task, a robot must decompose goals, select task-relevant objects, and sequence actions, while ensuring that plans satisfy spatial constraints such as limited free space and object collisions. In this work, we propose APIVOT, a VLM-based planner that adaptively interleaves language and visual thoughts for long-horizon planning. APIVOT learns to leverage language for semantic reasoning, while using visual thoughts as imagined future states for internal verification of geometric feasibility. On long-horizon kitchen tasks, APIVOT outperforms general-purpose VLMs and prior planning frameworks, achieving the largest gains in spatially constrained settings. We find that APIVOT learns meaningful modality selection behavior, demonstrating that adaptive interleaving of vision-language thoughts improves both planning success and reasoning efficiency.
School of Computer Science and Technology, Soochow University（苏州大学计算机科学与技术学院）；Department of Computer Science, The Hong Kong Polytechnic University（香港理工大学计算机科学系）
ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
National University of Singapore（新加坡国立大学）；Zhejiang University（浙江大学）；University of Washington（华盛顿大学）；Stanford University（斯坦福大学）；absolute AI；The Chinese University of Hong Kong（香港中文大学）
ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Models
School of Computer Science and Engineering, Central South University（计算机科学与工程学院，中南大学）；Research Center for SCIR, Harbin Institute of Technology（SCIR研究中心，哈尔滨工业大学）；NExT Research Center, National University of Singapore（NExT研究中心，新加坡国立大学）
ViC-Bench: Benchmarking Visual-Interleaved Chain-of-Thought Capability in MLLMs with Free-Style Intermediate State Representations
School of Computer Science and Technology, Xi’an Jiaotong University（西安交通大学计算机科学与技术学院）；Meituan Inc.（美团公司）；Institute of Advanced Technology, University of Science and Technology of China（中国科学技术大学先进技术研究院）；School of Computer Science and Technology, East China Normal University（华东师范大学计算机科学与技术学院）；Research Center for Space Computing System, Zhejiang Lab（浙江实验室空间计算系统研究中心）；College of Electronic and Information Engineering, Tongji University（同济大学电子与信息工程学院）；School of Robotics and Automation, Nanjing University（南京大学机器人与自动化学院）；College of Intelligent Robotics and Advanced Manufacturing, Fudan University（复旦大学智能机器人与先进制造学院）
Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought
School of Computer Science and Engineering, Central South University（中南大学计算机科学与工程学院）；Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology（哈尔滨工业大学社会计算与交互机器人研究中心）；Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen（哈尔滨工业大学深圳研究院计算与智能研究所）；Text Computing and Cognitive Intelligence Ministry of Education Engineering Research Center, Guizhou University（贵州大学文字计算与认知智能教育部工程研究中心）；Chinese University of Hong Kong（香港中文大学）；Shanghai AI Laboratory（上海人工智能实验室）；National University of Singapore（新加坡国立大学）；Peking University（北京大学）；ByteDance Seed (China)（字节跳动种子（中国））
VLM-R$^3$: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thought
National Engineering Research Center for Software Engineering, Peking University（软件工程国家工程研究中心，北京大学）；Alibaba Group（阿里巴巴集团）；ZEEKR Intelligent Technology Holding Limited（ZEKR智能科技控股有限公司）
Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space
The Hong Kong Polytechnic University（香港理工大学）；Singapore Management University（新加坡管理学院）；Shandong University（山东大学）；Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳））
Interleaved Tool-Call Reasoning for Protein Function Understanding
School of Computer Science and Technology, Soochow University（苏州大学计算机科学与技术学院）；Institute of Artificial Intelligence, Soochow University（苏州大学人工智能研究院）；Changping Laboratory（昌平实验室）；School of Software Engineering, USTC（中国科学技术大学软件学院）
Thinking with Constructions: A Benchmark and Policy Optimization for Visual-Text Interleaved Geometric Reasoning
College of Computer Science and Artificial Intelligence, Fudan University（复旦大学计算机科学与人工智能学院）；School of ECE, Peking University（北京大学电子工程学院）；School of Software and Microelectronics, Peking University（北京大学软件与微电子学院）；Tencent Youtu Lab（腾讯优图实验室）
Think-as-You-See: Streaming Chain-of-Thought Reasoning for Large Vision-Language Models
Institute of Digital Twin, Eastern Institute of Technology（数字孪生研究院，东技术学院）；Ocean University of China（中国海洋大学）；Shanghai Jiao Tong University（上海交通大学）；The Hong Kong Polytechnic University（香港理工大学）；Munich Center for Machine Learning, LMU Munich（慕尼黑机器学习中心，慕尼黑大学）；Ningbo Key Laboratory of Spatial Intelligence and Digital Derivative（宁波空间智能与数字衍生关键实验室）
Tsinghua University（清华大学）；Meituan Inc（美团公司）；Central South University（中南大学）；Peking University（北京大学）；University of Chinese Academy of Sciences（中国科学院大学）；Nanyang Technological University（南洋理工大学）
College of Computer Science, Sichuan University（四川大学计算机科学学院）；Southwest China Institute of Electronic Technology（西南中国电子技术研究所）；National Key Laboratory of Fundamental Algorithms（国家基础算法重点实验室）；Models for Engineering Simulation, Sichuan University（工程模拟模型研究所，四川大学）
VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning
Beijing University of Posts and Telecommunications（北京邮电大学）；University of Hong Kong（香港大学）；Beijing Shanwei Zhixing Technology Co., Ltd.（北京尚维智行科技有限公司）；Tsinghua University（清华大学）；Beihang University（北航）
Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University（西安交通大学人工智能与机器人研究所）；Xingchen AGI Lab, China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd（星辰通用人工智能实验室，中国电信人工智能技术（北京）有限公司）；University of Science and Technology Beijing（北京科技大学）；Beijing University of Posts and Telecommunications（北京邮电大学）；Shanghai Jiao Tong University（上海交通大学）
UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
University of Science and Technology of China（中国科学技术大学）；Tsinghua University（清华大学）；National University of Singapore（新加坡国立大学）；Zhongguancun Academy（中关村学院）
A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM
Beijing University of Posts and Telecommunications（北京邮电大学）；The Hong Kong Polytechnic University（香港理工大学）；Tsinghua University（清华大学）；JIUTIAN Research（中移九天）；OpenBMB
TumorChain: Interleaved Multimodal Chain-of-Thought Reasoning for Traceable Clinical Tumor Analysis
Zhejiang University（浙江大学）；DAMO Academy, Alibaba Group（阿里集团达摩院）；Hupan Lab（虎扑实验室）；Shanghai Institution of Pancreatic Disease（上海胰腺疾病研究所）；Shengjing Hospital of China Medical University（中国医科大学盛京医院）；Sun Yat-sen University Cancer Center（中山大学肿瘤中心）
While large language models (LLMs) have demonstrated impressive capabilities across tasks in language understanding and interactive decision making, their abilities for reasoning (e.g. chain-of-thought prompting) and acting (e.g. action plan generation) have primarily been studied as separate topics. In this paper, we explore the use of LLMs to generate both reasoning traces and task-specific actions in an interleaved manner, allowing for greater synergy between the two: reasoning traces help the model induce, track, and update action plans as well as handle exceptions, while actions allow it …
Evaluating Linguistic Capabilities of Multimodal LLMs in the Lens of Few-Shot Learning
Hacettepe University（哈杰泰佩大学）；Aselsan Research（阿塞尔桑研究院）；Koç University（科克大学）；Amsterdam UMC, University of Amsterdam（阿姆斯特丹大学医学中心，阿姆斯特丹大学）；Amsterdam Public Health（阿姆斯特丹公共卫生研究院）
A big convergence of language, multimodal perception, action, and world modeling is a key step toward artificial general intelligence. In this work, we introduce Kosmos-1, a Multimodal Large Language Model (MLLM) that can perceive general modalities, learn in context (i.e., few-shot), and follow instructions (i.e., zero-shot). Specifically, we train Kosmos-1 from scratch on web-scale multimodal corpora, including arbitrarily interleaved text and images, image-caption pairs, and text data. We evaluate various settings, including zero-shot, few-shot, and multimodal chain-of-thought prompting, on…
V-Retrver: Evidence-Driven Agentic Reasoning for Universal Multimodal Retrieval
Tsinghua University（清华大学）；University of Central Florida（中央佛罗里达大学）；Fudan University（复旦大学）；The Australian National University（澳大利亚国立大学）；The University of Hong Kong（香港大学）；Pengcheng Laboratory（鹏城实验室）；Central South University（中南大学）
Seeing is Not Reasoning: MVPBench for Graph-based Evaluation of Multi-path Visual Physical CoT
Central South University（中南大学）；University of Electronic Science and Technology of China（电子科技大学）；Peng Cheng Laboratory（鹏城实验室）；Nanjing University（南京大学）；Microsoft（微软公司）
