arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.11339cs.ROcs.MA
收藏

用于去中心化多机器人控制的深度强化学习:面向鲁棒性与信息整合的DQN方法

Deep Reinforcement Learning for Decentralized Multi-Robot Control: A DQN Approach to Robustness and Information Integration

Texas A&M University(德克萨斯农工大学)

Bin Wu, C Steve Suh

AI总结:

本研究提出一种基于DQN算法的去中心化多机器人控制器设计方法,通过共享学习机制整合局部信息,显著提升了系统在动态环境下的任务执行效率、容错能力与鲁棒性。

摘要:

多机器人系统(MRS)在各类复杂环境中的优越性是毋庸置疑的。然而,在搜救、环境监测和自动化生产等复杂场景中,通常要求机器人在没有中央控制单元的情况下协同工作。这就需要一种高效且鲁棒的去中心化控制机制来处理局部信息并指导机器人的行为。在本研究中,我们提出了一种新的去中心化控制器设计方法,该方法利用深度强化学习中的深度Q网络(DQN)算法,旨在改善多机器人系统的局部信息整合能力与鲁棒性。所设计的控制器允许每个机器人根据其局部观测独立做出决策,同时通过共享学习机制增强整个系统的协作效率和对动态环境的适应性。通过在模拟环境中的测试,我们证明了该控制器在提高任务执行效率、增强系统容错能力以及提升对环境的适应性方面的有效性。此外,我们还探讨了DQN参数调优对系统性能的影响,为进一步优化控制器设计提供了见解。我们的研究不仅展示了DQN算法在多机器人系统去中心化控制中的潜在应用,还就如何通过整合局部信息来提升系统的整体性能和鲁棒性提供了新视角。

英文摘要:

The superiority of Multi-Robot Systems (MRS) in various complex environments is unquestionable. However, in complex situations such as search and rescue, environmental monitoring, and automated production, robots are often required to work collaboratively without a central control unit. This necessitates an efficient and robust decentralized control mechanism to process local information and guide the robots' behavior. In this work, we propose a new decentralized controller design method that utilizes the Deep Q-Network (DQN) algorithm from deep reinforcement learning, aimed at improving the integration of local information and robustness of multi-robot systems. The designed controller allows each robot to make decisions independently based on its local observations while enhancing the overall system's collaborative efficiency and adaptability to dynamic environments through a shared learning mechanism. Through testing in simulated environments, we have demonstrated the effectiveness of this controller in improving task execution efficiency, strengthening system fault tolerance, and enhancing adaptability to the environment. Furthermore, we explored the impact of DQN parameter tuning on system performance, providing insights for further optimization of the controller design. Our research not only showcases the potential application of the DQN algorithm in the decentralized control of multi-robot systems but also offers a new perspective on how to enhance the overall performance and robustness of the system through the integration of local information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑