arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.14673cs.RO
收藏

利用大语言模型生成具表现力的机器人行为

Generative Expressive Robot Behaviors using Large Language Models

Google DeepMind(谷歌DeepMind);Hoku Labs(Hoku实验室)

Karthik Mahadevan, Jonathan Chien, Noah Brown, Zhuo Xu, Carolina Parada, Fei Xia, Andy Zeng, Leila Takayama, Dorsa Sadigh

AI总结:

针对现有机器人表现力行为生成方法扩展性差、需专用数据集的问题,提出利用大语言模型的少样本思维链提示将人类指令转为参数化控制代码,生成可适配组合的表现力机器人行为,经实验验证用户认可度高。

摘要:

人类会运用富有表现力的行为来有效地与他人沟通并协调行动,比如点头回应看向自己的人,或是在拥挤的走廊里说“借过”以便从人群中穿过。我们希望机器人在人机交互中也能展现出这类富有表现力的行为。此前的研究提出的基于规则的方法难以扩展到新的沟通模态或社交场景,而数据驱动的方法则需要为机器人的每一种应用社交场景准备专门的数据集。我们提出利用大语言模型(LLMs)具备的丰富社交上下文知识,以及它们根据指令或用户偏好生成动作的能力,生成具有适应性且可组合、能够相互叠加的表现力机器人动作。我们的方法采用少样本思维链提示,将人类语言指令转化为调用机器人可用及已习得技能的参数化控制代码。通过用户研究和仿真实验,我们证明该方法生成的行为在用户看来既称职又易于理解。补充材料可参见https://generative-expressive-motion.github.io/。

英文摘要:

People employ expressive behaviors to effectively communicate and coordinate their actions with others, such as nodding to acknowledge a person glancing at them or saying "excuse me" to pass people in a busy corridor. We would like robots to also demonstrate expressive behaviors in human-robot interaction. Prior work proposes rule-based methods that struggle to scale to new communication modalities or social situations, while data-driven methods require specialized datasets for each social situation the robot is used in. We propose to leverage the rich social context available from large language models (LLMs) and their ability to generate motion based on instructions or user preferences, to generate expressive robot motion that is adaptable and composable, building upon each other. Our approach utilizes few-shot chain-of-thought prompting to translate human language instructions into parametrized control code using the robot's available and learned skills. Through user studies and simulation experiments, we demonstrate that our approach produces behaviors that users found to be competent and easy to understand. Supplementary material can be found at https://generative-expressive-motion.github.io/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑