CoPAL: Corrective Planning of Robot Actions with Large Language Models
Honda Research Institute Europe(本田欧洲研究院)
Frank Joublin, Antonello Ceravola, Pavel Smirnov, Felix Ocker, Joerg Deigmoeller, Anna Belardinelli, Chao Wang, Stephan Hasler, Daniel Tanneberg, Michael Gienger
In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable challenge. Addressing this imperative, this study contributes to the field of Large Language Models (LLMs) applied to task and motion planning for robots. We propose a system architecture that orchestrates a seamless interplay between multiple cognitive levels, encompassing reasoning, planning, and motion generation. At its core lies a novel replanning strategy that handles physically grounded, logical, and semantic errors in the generated plans. We demonstrate the efficacy of the proposed feedback architecture, particularly its impact on executability, correctness, and time complexity via empirical evaluation in the context of a simulation and two intricate real-world scenarios: blocks world, barman and pizza preparation.
RESETTLE: Robotic Recovery through Disagreement-Triggered Retrieval and Efficient Corrective Control
The Hong Kong University of Science and Technology(香港科技大学);The Chinese University of Hong Kong(香港中文大学);SmartMore(思谋科技);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Shenzhen Loop Area Institute(深圳河套学院)
AlignBot: Aligning VLM-powered Customized Task Planning with User Reminders Through Fine-Tuning for Household Robots
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The University of Hong Kong(香港大学);University of Bristol(布里斯托大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Northwestern Polytechnical University(西北工业大学);Institute of Artificial Intelligence, China Telecom Corp Ltd(中国电信股份有限公司人工智能研究院)
Reflect-VLA: Internalizing Reflective Guidance via Dual-Path On-Policy Self-Distillation for Autonomous Driving
Tsinghua University(清华大学);University of Macau(澳门大学);University of Science and Technology of China(中国科学技术大学);Beijing Jiaotong University(北京交通大学);Nanyang Technological University(南洋理工大学)
RAMBO: RL-Augmented Model-Based Whole-Body Control for Loco-Manipulation
Computational Robotics Lab in the Department of Computer Science, ETH Zurich(苏黎世联邦理工学院计算机科学系计算机器人实验室);Robotics Institute and the School of Computer Science at Carnegie Mellon University(卡内基梅隆大学机器人研究所和计算机科学学院)
Embodied Tree of Thoughts: Deliberate Manipulation Planning with Embodied World Model
University of Chinese Academy of Sciences (UCAS)(中国科学院大学);Tsinghua University(清华大学);JD Explore Academy(京东探索学院);ShanghaiTech University(上海科技大学);Nanjing University(南京大学)
Think, Act, Learn: A Framework for Autonomous Robotic Agents using Closed-Loop Large Language Models
Dept. of Electronics & Comm. Eng.(电子与通信工程系);Government Engineering College(政府工程学院);Dept. of Electrical & Electronics Eng.(电气与电子工程系);Poornima College of Engineering(波奥尼玛工程学院);Dept. of Electronics & Telecom. Eng.(电子与电信工程系);Shivaji University College of Eng.(希瓦吉大学工程学院);Department of Computer Science(计算机科学系);San Francisco State University(旧金山州立大学);Dept. of Electrical Eng.(电气工程系);Instituto Federal do Maranhão(马里兰联邦学院);Dept. of Electrical & Computer Eng.(电气与计算机工程系);Technical University of Košice(科希丘夫技术大学)
FPC-VLA: A Vision-Language-Action Framework with a Supervisor for Failure Prediction and Correction
The Institute of Robotics and Automatic Information System(机器人与自动信息系统研究所);Tianjin Key Laboratory of Intelligent Robotics(智能机器人天津重点实验室);TBI Center, Nankai University, Tianjin 300350, China(南开大学天津中心);Faculty of Robot Science and Engineering, Northeastern University, Shenyang 110819, China(机器人科学与工程学院);The State Key Laboratory of Internet of Things for Smart City(智能城市物联网国家重点实验室);Centre for Artificial Intelligence(人工智能中心);Department of Electromechanical Engineering, University of Macau, Macau SAR, China(机电工程系,澳门大学)
HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);ImprintX Robotics(ImprintX机器人公司);Beijing Academy of Artificial Intelligence(北京人工智能研究院)