arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.21119cs.ROcs.AI
收藏

现实世界工艺机器人的协作-竞争团队合作

Cooperative-Competitive Team Play of Real-World Craft Robots

Tencent Robotics X Laboratory(腾讯机器人实验室);Tsinghua University(清华大学)

Rui Zhao, Xihui Li, Yizheng Zhang, Yuzhen Liu, Zhong Zhang, Yufeng Zhang, Cheng Zhou, Zhengyou Zhang, Lei Han

AI总结:

本文提出了一种针对现实世界工艺机器人协作与竞争任务的强化学习方法,通过引入OODSI技术提升仿真到现实的迁移性能。

摘要:

多智能体深度强化学习(RL)近年来在开发智能游戏扮演代理方面取得了显著进展。然而,使用多智能体RL高效训练集体机器人以及将学习的策略转移到现实世界应用仍是一个开放的研究问题。在本工作中,我们首先开发了一个综合的机器人系统,包括模拟、分布式学习框架和物理机器人组件。然后,我们提出并评估了为在该平台上高效训练协作和竞争策略而设计的强化学习技术。为了解决多智能体仿真到现实的转移挑战,我们引入了Out of Distribution State Initialization(OODSI)以减轻仿真到现实的差距影响。在实验中,OODSI将Sim2Real性能提高了20%。我们通过多机器人汽车竞争游戏和现实世界中的协作任务实验展示了我们方法的有效性。

英文摘要:

Multi-agent deep Reinforcement Learning (RL) has made significant progress in developing intelligent game-playing agents in recent years. However, the efficient training of collective robots using multi-agent RL and the transfer of learned policies to real-world applications remain open research questions. In this work, we first develop a comprehensive robotic system, including simulation, distributed learning framework, and physical robot components. We then propose and evaluate reinforcement learning techniques designed for efficient training of cooperative and competitive policies on this platform. To address the challenges of multi-agent sim-to-real transfer, we introduce Out of Distribution State Initialization (OODSI) to mitigate the impact of the sim-to-real gap. In the experiments, OODSI improves the Sim2Real performance by 20%. We demonstrate the effectiveness of our approach through experiments with a multi-robot car competitive game and a cooperative task in real-world settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑