arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.14558cs.ROcs.AI
收藏

CooHOI:基于被操作物体动力学学习协作型人-物交互

CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics

Tsinghua University(清华大学);Beihang University(北京航空航天大学);Shanghai AI Laboratory(上海人工智能实验室);Nanyang Technological University(南洋理工大学);Carnegie Mellon University(卡内基梅隆大学)

Jiawei Gao, Ziqin Wang, Zeqi Xiao, Jingbo Wang, Tai Wang, Jinkun Cao, Xiaolin Hu, Si Liu, Jifeng Dai, Jiangmiao Pang

AI总结:

针对多仿人协作搬运任务缺动作捕捉数据、多智能体学习效率低的问题,提出CooHOI框架,通过个体模仿学习加基于物体共享动力学的CTDE多智能体强化学习两阶段范式,实现高效可扩展的多仿人隐式协作。

摘要:

让仿人机器人能够打扫房间一直是仿人机器人研究领域长期追求的目标。然而,许多任务需要多个仿人机器人协作完成,比如共同搬运大型且沉重的家具。由于多仿人协作的动作捕捉数据十分稀缺,且多智能体学习存在效率方面的挑战,这些任务无法直接采用为单智能体场景设计的训练范式来解决。本文提出了协作型人-物交互(Cooperative Human-Object Interaction,简称CooHOI)框架,该框架通过两阶段学习范式解决多仿人物体搬运问题:第一阶段为个体技能学习,第二阶段为后续的策略迁移。首先,单个仿人角色通过从人类运动先验中进行模仿学习,掌握与物体交互的能力。随后,仿人机器人采用集中式训练、分布式执行(CTDE)的多智能体强化学习算法,通过考量被操作物体的共享动力学特性,学习与其他个体协作。当一个智能体与物体交互并引发特定的物体动力学变化时,其他智能体学习做出恰当响应,从而实现队友之间的隐式通信与协调。与以往依赖基于跟踪方法的多仿人人-物交互(HOI)研究不同,CooHOI本身具备高效性,不依赖多仿人交互的动作捕捉数据,并且可以无缝扩展至更多参与主体以及广泛的物体类型。

英文摘要:

Enabling humanoid robots to clean rooms has long been a pursued dream within humanoid research communities. However, many tasks require multi-humanoid collaboration, such as carrying large and heavy furniture together. Given the scarcity of motion capture data on multi-humanoid collaboration and the efficiency challenges associated with multi-agent learning, these tasks cannot be straightforwardly addressed using training paradigms designed for single-agent scenarios. In this paper, we introduce Cooperative Human-Object Interaction (CooHOI), a framework designed to tackle the challenge of multi-humanoid object transportation problem through a two-phase learning paradigm: individual skill learning and subsequent policy transfer. First, a single humanoid character learns to interact with objects through imitation learning from human motion priors. Then, the humanoid learns to collaborate with others by considering the shared dynamics of the manipulated object using centralized training and decentralized execution (CTDE) multi-agent RL algorithms. When one agent interacts with the object, resulting in specific object dynamics changes, the other agents learn to respond appropriately, thereby achieving implicit communication and coordination between teammates. Unlike previous approaches that relied on tracking-based methods for multi-humanoid HOI, CooHOI is inherently efficient, does not depend on motion capture data of multi-humanoid interactions, and can be seamlessly extended to include more participants and a wide range of object types.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑