arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2504.02479cs.LGcs.AIcs.MAcs.SYeess.SYstat.ML
收藏

用于非内聚目标多智能体牧羊控制的分层策略梯度强化学习

Hierarchical Policy-Gradient Reinforcement Learning for Multi-Agent Shepherding Control of Non-Cohesive Targets

Scuola Superiore Meridionale(南方高等学院);University of Naples Federico II(那不勒斯费德里科二世大学)

Stefano Covone, Italo Napolitano, Francesco De Lellis, Mario di Bernardo

AI总结:

本文提出一种基于策略梯度的分散式强化学习框架,通过Proximal Policy Optimization整合目标选择与驱动,克服了传统DQN的离散动作限制,在无先验动力学知识下有效解决了非内聚目标的多智能体牧羊问题,并验证了其可扩展性。

摘要:

我们提出一种用于非内聚目标多智能体牧羊的分散式强化学习解决方案,采用策略梯度方法。我们的架构通过Proximal Policy Optimization将目标选择与目标驱动相结合,克服了以往Deep Q-Network方法的离散动作限制,并实现了更平滑的智能体轨迹。这种无模型框架无需先验动力学知识即可有效解决牧羊问题。实验证明了该方法在目标数量增加和传感能力受限时的有效性与可扩展性。

英文摘要:

We propose a decentralized reinforcement learning solution for multi-agent shepherding of non-cohesive targets using policy-gradient methods. Our architecture integrates target-selection with target-driving through Proximal Policy Optimization, overcoming discrete-action constraints of previous Deep Q-Network approaches and enabling smoother agent trajectories. This model-free framework effectively solves the shepherding problem without prior dynamics knowledge. Experiments demonstrate our method's effectiveness and scalability with increased target numbers and limited sensing capabilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑