arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.07265cs.RO
收藏

面向机器人与人类协作的多模态强化学习

Multimodal Reinforcement Learning for Robots Collaborating with Humans

University of Illinois Chicago(伊利诺伊大学芝加哥分校);California State University Channel Islands(加州州立大学海峡群岛分校)

Afagh Mehri Shervedani, Siyu Li, Natawut Monaikul, Bahareh Abbasi, Barbara Di Eugenio, Milos Zefran

AI总结:

本文提出一种多模态强化学习方法学习机器人协作策略,通过人类数据开发的模拟器处理语言和物理动作,经人类研究评估在真实用户交互中取得有前景的初步结果。

摘要:

面向老年人和残疾人的机器人助手需要在协作任务中与用户进行交互。这些系统的核心组件是交互管理器,其职责是观察和评估任务,推断人类的状态及其意图,从而为机器人选择最佳行动方案。由于该领域数据的稀疏性,此类多模态系统的策略通常是手工设计的;随着交互复杂性的增加,这一过程不具备可扩展性。在本文中,我们提出了一种强化学习(RL)方法来学习机器人策略。与对话系统不同,我们的智能体通过使用人类数据开发的模拟器进行训练,并且能够处理语言和物理动作等多种模态。我们进行了一项人类研究,以评估系统在与用户交互时的性能。当被真实用户使用时,我们设计的系统展现出了有前景的初步结果。

英文摘要:

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer the state of the human and their intent to choose the best course of action for the robot. Due to the sparseness of the data in this domain, the policy for such multi-modal systems is often crafted by hand; as the complexity of interactions grows this process is not scalable. In this paper, we propose a reinforcement learning (RL) approach to learn the robot policy. In contrast to the dialog systems, our agent is trained with a simulator developed by using human data and can deal with multiple modalities such as language and physical actions. We conducted a human study to evaluate the performance of the system in the interaction with a user. Our designed system shows promising preliminary results when it is used by a real user.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑