arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.01958cs.RO
收藏

分布式协同传输的事件触发通信和基于共识控制的深度强化学习

Deep reinforcement learning of event-triggered communication and consensus-based control for distributed cooperative transport

Nara Institute of Science and Technology(奈良先端科学技术大学院大学)

Kazuki Shibata, Tomohiko Jimbo, Takamitsu Matsubara

摘要:

在本文中,我们提出了一个解决方案的多智能体合作运输的控制策略的设计问题。虽然现有的基于学习的方法假设智能体的数量与训练环境中的智能体的数量相同,但考虑到机器人的电池可能完全放电,或者可能引入额外的机器人以减少完成任务所需的时间,实际上智能体的数量可能会有所不同。因此,至关重要的是,学习的策略适用于代理的数量不同于训练环境中的代理的情况。在本文中,我们提出了一种新的多智能体强化学习框架的事件触发通信和基于共识的控制分布式合作运输。所提出的政策模型估计合力和扭矩的共识的方式使用的合力和扭矩的估计与邻域代理。此外,它还计算控制和通信输入,以确定何时在局部观测和合力和扭矩估计下与相邻代理进行通信。因此,所提出的框架可以平衡的控制性能和通信节省的情况下,代理的数量不同于在训练环境中。我们通过在模拟和实验中分别使用最多8个和6个机器人来确认我们方法的有效性。

英文摘要:

In this paper, we present a solution to a design problem of control strategies for multi-agent cooperative transport. Although existing learning-based methods assume that the number of agents is the same as that in the training environment, the number might differ in reality considering that the robots' batteries may completely discharge, or additional robots may be introduced to reduce the time required to complete a task. Therefore, it is crucial that the learned strategy be applicable to scenarios wherein the number of agents differs from that in the training environment. In this paper, we propose a novel multi-agent reinforcement learning framework of event-triggered communication and consensus-based control for distributed cooperative transport. The proposed policy model estimates the resultant force and torque in a consensus manner using the estimates of the resultant force and torque with the neighborhood agents. Moreover, it computes the control and communication inputs to determine when to communicate with the neighboring agents under local observations and estimates of the resultant force and torque. Therefore, the proposed framework can balance the control performance and communication savings in scenarios wherein the number of agents differs from that in the training environment. We confirm the effectiveness of our approach by using a maximum of eight and six robots in the simulations and experiments, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑