16 pages, 9 figures; This article has been accepted for publication in a future issue of IEEE/CAA Journal of Automatica Sinica, but has not been fully edited. Content may change prior to final publication
Service robots are increasingly entering the home to provide domestic tasks for residents. However, when working in an open, dynamic, and unstructured home environment, service robots still face challenges such as low intelligence for task execution and poor long-term autonomy (LTA), which has limited their deployment. As the basis of robotic task execution, environment modeling has attracted significant attention. This integrates core technologies such as environment perception, understanding, and representation to accurately recognize environmental information. This paper presents a comprehensive survey of environmental modeling from a new task-executionoriented perspective. In particular, guided by the requirements of robots in performing domestic service tasks in the home environment, we systematically review the progress that has been made in task-execution-oriented environmental modeling in four respects: 1) localization, 2) navigation, 3) manipulation, and 4) LTA. Current challenges are discussed, and potential research opportunities are also highlighted.
Pre-Execution Safety Gate & Task Safety Contracts for LLM-Controlled Robot Systems
SMART Laboratory, Department of Computer and Information Technology, Purdue University(普渡大学计算机与信息技术系SMART实验室);Department of Information and Telecommunication Engineering, Incheon National University(仁川国立大学信息与通信工程系)
Reliable Robotic Task Execution in the Face of Anomalies
NEURA Robotics(NEURA机器人公司);Chalmers University of Technology(楚姆勒斯技术大学);Fraunhofer Institute for Intelligent Analysis and Information Systems(弗劳恩霍夫智能分析与信息系统研究所);Institute for Artificial Intelligence and Autonomous Systems (A 2 S)(人工智能与自主系统研究所)
From Dialogue to Execution: Mixture-of-Agents Assisted Interactive Planning for Behavior Tree-Based Long-Horizon Robot Execution
Waseda University(早稻田大学);National Institute of Informatics(国家信息研究所);NII Research and Development Center for Large Language Models(国家信息研究所大型语言模型研究开发中心);The Graduate University for Advanced Studies (SOKENDAI)(高级研究大学研究生院(SOKENDAI))
COFFAIL: A Dataset of Successful and Anomalous Robot Skill Executions in the Context of Coffee Preparation
Division of Systems and Control, Chalmers University of Technology(系统与控制系,楚姆勒斯理工大学);Bonn-Rhein-Sieg University of Applied Sciences(波恩-莱茵-西弗大学);Autonomous Systems Group, Bonn-Rhein-Sieg University of Applied Sciences(自主系统组,波恩-莱茵-西弗大学)
HuBE: Cross-Embodiment Human-like Behavior Execution for Humanoid Robots
Department of Mechanical Engineering, The Hong Kong Polytechnic University (PolyU)(机械工程系,香港理工大学(PolyU));Research Institute for Smart Ageing (RISA), PolyU(智能老龄化研究所以及PolyU);Ningbo Institute of Digital Twin, Eastern Institute of Technology (EIT)(宁波数字孪生研究所,东部技术研究所(EIT))
SwiftBot: A Decentralized Platform for LLM-Powered Federated Robotic Task Execution
California State University, Long Beach, USA(加州州立大学长滩分校);Case Western Reserve University, USA(凯斯西储大学);University of Colorado Denver, USA(科罗拉多大学丹佛分校);Montana State University, USA(蒙塔那州立大学);University of Houston Clear Lake, USA(休斯顿大学clear lake分校)
Large language model-based task planning for service robots: A review
School of Electrical Engineering, Yanshan University(燕山大学电气工程学院);Engineering Research Center of Intelligent Control System and Intelligent Equipment, Ministry of Education, Yanshan University(燕山大学智能控制与设备工程研究中心);Hebei Key Laboratory of Intelligent Rehabilitation and Neuromodulation, Yanshan University(河北省智能康复与神经调制重点实验室);School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院);National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University(国家机器人视觉感知与控制技术工程研究中心);Department of Automation, Shanghai Jiao Tong University(上海交通大学自动化系);Advanced Robotics and Intelligent Systems Laboratory, School of Engineering, University of Guelph(圭尔夫大学工程学院先进机器人与智能系统实验室)
RoboRecover: Benchmarking Robot Policy Recovery under Execution Deviations
School of Information, Renmin University of China(中国人民大学信息学院);Key Laboratory of Data Engineering and Knowledge Engineering(数据工程与知识工程重点实验室);University of Science and Technology of China(中国科学技术大学);Engineering Research Center of Database and Business Intelligence(数据库与商务智能工程研究中心)
Service Pet Robot Design: Queer, Feminine and Sexuality Aspects
School of Educational & Social Policies, University of Macedonia(马其顿大学教育与社会政策学院);University of Macedonia(马其顿大学);UCLA School of Art & Architecture(加州大学洛杉矶分校艺术与建筑学院)
TemporalFlow-VLA: Learning Physically Grounded Execution History for Long-Horizon Robot Manipulation
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Zhejiang University(浙江大学);Simon Fraser University(西蒙菲莎大学);AgiBot(云圣智能科技(上海)有限公司)