PointCoT: A Multi-modal Benchmark for Explicit 3D Geometric Reasoning
Xi'an Jiaotong University(西安交通大学);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);Zhejiang University(浙江大学);Nanyang Technological University(南洋理工大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Institute of Automation, CASIA(中国科学院自动化研究所);Taiyuan University of Technology(太原理工大学);Shanghai AI Laboratory(上海人工智能实验室)
While Multimodal Large Language Models (MLLMs) demonstrate proficiency in 2D scenes, extending their perceptual intelligence to 3D point cloud understanding remains a significant challenge. Current approaches focus primarily on aligning 3D features with pre-trained models. However, they typically treat geometric reasoning as an implicit mapping process. These methods bypass intermediate logical steps and consequently suffer from geometric hallucinations. They confidently generate plausible responses that fail to ground in precise structural details. To bridge this gap, we present PointCoT, a novel framework that empowers MLLMs with explicit Chain-of-Thought (CoT) reasoning for 3D data. We advocate for a \textit{Look, Think, then Answer} paradigm. In this approach, the model is supervised to generate geometry-grounded rationales before predicting final answers. To facilitate this, we construct Point-Reason-Instruct, a large-scale benchmark comprising $\sim$86k instruction-tuning samples with hierarchical CoT annotations. By leveraging a dual-stream multi-modal architecture, our method synergizes semantic appearance with geometric truth. Extensive experiments demonstrate that PointCoT achieves state-of-the-art performance on complex reasoning tasks.
ChartPoint: Guiding MLLMs with Grounding Reflection for Chart Reasoning
Tsinghua University(清华大学);International Digital Economy Academy(国际数字经济学院);Beihang University(北航);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Truth in the Few: High-Value Data Selection for Efficient Multi-Modal Reasoning
University of Electronic Science and Technology of China(电子科技大学);School of Computer Science and Engineering(计算机科学与工程学院);Tongji University(同济大学);School of Computer Science and Technology(计算机科学与技术学院)
Separate First, Fuse Later: Mitigating Cross-Modal Interference in Audio-Visual LLMs Reasoning with Modality-Specific Chain-of-Thought
Tianjin Key Laboratory of Cognitive Computing(天津认知计算实验室);Tianjin University(天津大学);Huiyan Technology Company, Ltd.(慧颜科技有限公司);Chinese Academy of Sciences(中国科学院);Tencent(腾讯)
The Multi-Modal Video Reasoning and Analyzing Competition
Singapore University of Technology and Design(新加坡科技设计大学);Lancaster University(兰卡斯特大学);University of Melbourne(墨尔本大学);Xidian University(西安电子科技大学);Jiangnan University(江南大学);Wuhan University(武汉大学);Tsinghua University(清华大学);Sun Yat-sen University(中山大学);BOE Technology Group Co., Ltd(京东方科技集团股份有限公司)
From Consistency to Complementarity: Aligned and Disentangled Multi-modal Learning for Time Series Understanding and Reasoning
The Hong Kong University of Science(香港科学与技术大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)
M$^3$-Med: A Benchmark for Multi-lingual, Multi-modal, and Multi-hop Reasoning in Medical Instructional Video Understanding
Beijing Institute of Technology(北京理工大学);The Hong Kong Polytechnic University(香港理工大学);Chinese Academy of Sciences(中国科学院);Air Force Hospital of Southern Theater Command of PLA(中国人民解放军南部战区空军医院);Shenzhen Traditional Chinese Medicine Hospital(深圳中医药医院)
Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based Visual Question Answering
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Microsoft Research Asia(微软亚洲研究院);University of Adelaide(阿德莱德大学)
LLMs Can Evolve Continually on Modality for X-Modal Reasoning
Dalian University of Technology(大连理工大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Tsinghua University(清华大学);The Hong Kong University of Science and Technology(香港科技大学)
Red-teaming the Multimodal Reasoning: Jailbreaking Vision-Language Models via Cross-modal Entanglement Attacks
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);People’s Public Security University of China(中国人民公安大学)
When Modalities Conflict: How Unimodal Reasoning Uncertainty Governs Preference Dynamics in MLLMs
Peking University(北京大学);Provable Responsible AI and Data Analytics (PRADA) Lab(可证明负责任的人工智能和数据分析实验室);King Abdullah University of Science and Technology(卡布斯大学);South China University of Technology(华南理工大学);Tsinghua University(清华大学);University of Georgia(佐治亚大学);MBZUAI(马克斯·普朗克人工智能研究所)
When Reasoning Is Not Enough: Proactive Inquiry for Cross-Modal Safety in Multimodal Large Language Models
Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI));Peking University(北京大学);School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University(西北工业大学人工智能与光电子学院(iOPEN))
Chat-TS: Enhancing Multi-Modal Reasoning Over Time-Series and Natural Language Data
Electrical and Computer Engineering, Queen’s University(皇后大学电气与计算机工程学院);Mechanical and Materials Engineering, Queen’s University(皇后大学机械与材料工程学院);Ingenuity Labs Research Institute, Queen’s University(皇后大学创新实验室研究 institute)
Scaling-Aware Adapter for Structure-Grounded LLM Reasoning
Department of Computer Science, Western University, London, Canada(加拿大伦敦西方大学计算机科学系);Department of Biochemistry, Western University, London, Canada(加拿大伦敦西方大学生物化学系)