Spatial reasoning is an essential problem in embodied AI research. Efforts to enhance spatial reasoning abilities through supplementary spatial data and fine-tuning have proven limited and ineffective when addressing complex embodied tasks, largely due to their dependence on language-based outputs. While some approaches have introduced a point-based action space to mitigate this issue, they fall short in managing more intricate tasks within complex environments. This deficiency arises from their failure to fully exploit the inherent thinking and reasoning capabilities that are fundamental strengths of Vision-Language Models (VLMs). To address these limitations, we propose a novel approach named SpatialCoT, specifically designed to bolster the spatial reasoning capabilities of VLMs. Our approach comprises two stages: spatial coordinate bi-directional alignment, which aligns vision-language inputs with spatial coordinates, and chain-of-thought spatial grounding, which harnesses the reasoning capabilities of language models for advanced spatial reasoning. We evaluate SpatialCoT on challenging navigation and manipulation tasks, both in simulation and real-world settings. Experimental results demonstrate that our method significantly outperforms previous state-of-the-art approaches in both tasks.
Advancing Embodied Intelligence in Robotic-Assisted Endovascular Procedures: A Systematic Review of AI Solutions
Department of Control Science and Engineering, College of Electronics and Information Engineering, and Shanghai Institute of Intelligent Science and Technology, Tongji University（控制科学与工程系，电子信息工程学院，上海智能科学技术研究院，同济大学）；Department of Electronic Engineering, Faculty of Engineering, The Chinese University of Hong Kong（电子工程系，工程学院，香港中文大学）；Robotics and Microsystems Center, School of Mechanical and Electrical Engineering, Soochow University（机器人与微系统中心，机械与电气工程学院，苏州大学）；Siemens Healthineers Advanced Therapies (AT), Forchheim, Bavaria（西门子医疗先进治疗（AT）, Forchheim, 巴伐利亚）；HUB of Intelligent Neuro-Engineering (HUBIN), CREATe, Division of Surgery & Interventional Science, University College London（智能神经工程中心（HUBIN），CREATE，外科与介入科学系，伦敦大学学院）；School of Biomedical Engineering & Imaging Sciences, King’s College London（生物医学工程与成像科学学院，伦敦国王学院）
ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Models
Beijing University of Posts and Telecommunications（北京邮电大学）；State Key Laboratory of Networking and Switching Technology（网络与交换技术国家重点实验室）；School of Materials Science and Engineering（材料科学与工程学院）；China Mobile Research Institute（中国移动研究院）；College of Computing and Data Science（计算与数据科学学院）
VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learning
Shanghai Jiao Tong University（上海交通大学）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；University of Science and Technology of China（中国科学技术大学）；University of Oxford（牛津大学）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））
Embodied Intelligence for Flexible Manufacturing: A Survey
National University of Defense Technology（中国人民解放军国防科技大学）；Wuhan University（武汉大学）；Shenzhen University（深圳大学）；Hunan University（湖南大学）；Shenyang Institute of Automation Chinese Academy of Sciences（中国科学院沈阳自动化研究所）
Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）；AiRiA；Nanjing University of Information Science and Technology（南京信息科学技术大学）
Embodied AI: Emerging Risks and Opportunities for Policy Action
Centre for the Governance of AI（治理人工智能中心）；French Center for AI Safety (CeSIA)（法国人工智能安全中心）；Carnegie Mellon University（卡内基梅隆大学）；University of Oxford（牛津大学）；University of Bologna（博洛尼亚大学）；Tony Blair Institute for Global Change（托尼·布莱尔全球变革研究所）；Yale University（耶鲁大学）；Yale Digital Ethics Center（耶鲁数字伦理中心）
EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents
The University of Hong Kong（香港大学）；Tampere University（坦佩雷大学）；The Chinese University of Hong Kong（香港中文大学）；Max-Planck Institute for Informatics（马克斯·普朗克信息学研究所）
Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Georgia Institute of Technology（佐治亚理工学院）；University of Texas at Dallas（德克萨斯大学达拉斯分校）
SceneFoundry: Generating Interactive Infinite 3D Worlds
National Yang Ming Chiao Tung University（国家阳明交通大学）；National Tsing Hua University（国立清华大学）；NVIDIA AI Technology Center（NVIDIA AI技术中心）；National Taiwan University（国立台湾大学）
Concept-Based Dictionary Learning for Inference-Time Safety in Vision Language Action Models
Beijing Jiaotong University（北京交通大学）；Provable Responsible AI and Data Analytics (PRADA) Lab（可证责任AI与数据分析实验室）；King Abdullah University of Science and Technology（国王 Abdullah 科学技术大学）；University of Auckland（奥克兰大学）；RIKEN Center for Advanced Intelligence Project (AIP)（理化学研究所高级智能项目中心）；Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)（穆罕默德·本·扎耶德人工智能大学）
Active Spatial Inspection for Effective and Efficient Embodied Exploration
The Hong Kong Polytechnic University（香港理工大学）；China Three Gorges University（三峡大学）；Huazhong University of Science and Technology（华中科技大学）；Shenzhen University（深圳大学）；Nanjing University of Aeronautics and Astronautics（南京航空航天大学）
U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences
Nanjing University of Aeronautics and Astronautics（南京航空航天大学）；National University of Singapore（新加坡国立大学）；Fudan University（复旦大学）；S-Lab, Nanyang Technological University（南洋理工大学S实验室）；Nanjing University of Posts and Telecommunications（南京邮电大学）；SKL-TI
MonoSR: Open-Vocabulary Spatial Reasoning from Monocular Images
Technical University of Munich（慕尼黑工业大学）；A*STAR Institute of Advanced Intelligence and Computing（新加坡科技研究局高级智能与计算研究所）；Singapore University of Technology and Design（新加坡科技设计大学）；Nanyang Technological University（南洋理工大学）
TinyLVLM-eHub: Towards Comprehensive and Efficient Evaluation for Large Vision-Language Models
The University of Hong Kong（香港大学）；Peking University（北京大学）；OpenGVLab（开放智能机器研究中心）；Shanghai AI Laboratory（上海人工智能实验室）；The Chinese University of Hong Kong（香港中文大学）
Vision Language Action Models in Robotic Manipulation: A Systematic Review
Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University, United Arab Emirates（卡利法大学自主机器人系统中心（KUCARS）、卡利法大学、阿拉伯联合酋长国）；Institute of Industrial and Control Engineering (IOC), Universitat Politecnica de Catalunya, Spain（工业与控制工程研究所（IOC）、巴塞罗那技术大学、西班牙）
MolmoAct2: Action Reasoning Models for Real-world Deployment
Allen Institute for AI（艾伦人工智能研究所）；University of Washington（华盛顿大学）；National University of Singapore（新加坡国立大学）；University of Pennsylvania（宾夕法尼亚大学）；Johns Hopkins University（约翰霍普金斯大学）；Amazon（亚马逊公司）；University of Michigan（密歇根大学）；University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）
S-Lab, College of Computing and Data Science, Nanyang Technological University（S实验室，计算与数据科学学院，南洋理工大学）；Intelligent Graphics Lab, The Hong Kong University of Science and Technology（智能图形实验室，香港科学与技术大学）
How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective
ARC Lab, Tencent PCG（腾讯PCG部门ARC实验室）；Shanghai Jiao Tong University（上海交通大学）；University of Macau（澳门大学）；Dalian University of Technology（大连理工大学）；The Chinese University of Hong Kong（香港中文大学）
Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applications
Shandong University（山东大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）
