arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.04086cs.RO
收藏

基于语言的机器人通信综述

A Survey of Language-Based Communication in Robotics

University of Southampton(南安普顿大学)

William Hunt, Sarvapali D. Ramchurn, Mohammad D. Soorati

AI总结:

本文综述了语言模型在机器人控制与人机、机机通信中的应用,按语言在控制流程中的位置分类,并探讨应用、局限与未来发展方向。

摘要:

能够与环境及邻近对象交互的具身机器人正日益被用作发展人工智能的测试案例。这产生了对能够跨不同类型信息(包括文本)运行的多模态机器人控制器的需求。大型语言模型能够处理并生成文本以及视听数据,并且最近还能生成机器人动作。语言模型正越来越多地应用于机器人系统;这些基于语言的机器人以多种方式利用语言模型的能力。此外,语言的使用开启了人机团队成员之间多种形式的信息交换。本综述首先阐述了在机器人学中使用语言模型的动机,然后根据语言被纳入整体控制流程的环节对相关工作进行划分。语言可以由人类用来向机器人下达任务,可以由机器人用来向人类传递信息,可以在机器人之间作为一种类人的通信媒介使用,也可以在机器人内部用于规划和控制。本文探讨了基于语言的机器人的应用,并讨论了众多局限性与挑战,以总结基于语言的机器人学未来发展所需的进展。

英文摘要:

Embodied robots which can interact with their environment and neighbours are increasingly being used as a test case to develop Artificial Intelligence. This creates a need for multimodal robot controllers that can operate across different types of information, including text. Large Language Models are able to process and generate textual as well as audiovisual data and, more recently, robot actions. Language Models are increasingly being applied to robotic systems; these Language-Based robots leverage the power of language models in a variety of ways. Additionally, the use of language opens up multiple forms of information exchange between members of a human-robot team. This survey motivates the use of language models in robotics, and then delineates works based on the part of the overall control flow in which language is incorporated. Language can be used by human to task a robot, by a robot to inform a human, between robots as a human-like communication medium, and internally for a robot's planning and control. Applications of language-based robots are explored, and numerous limitations and challenges are discussed to provide a summary of the development needed for the future of language-based robotics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑