arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.15807cs.ROcs.AIcs.LGcs.MA
收藏

使用强化学习将机器人群引导到目标分布

Using Reinforcement Learning to Herd a Robotic Swarm to a Target Distribution

Arizona State University(亚利桑那州立大学);University of California, Los Angeles(加州大学洛杉矶分校)

Zahi M. Kakish, Karthik Elamvazhuthi, Spring Berman

摘要:

在本文中,我们提出了一个强化学习的方法来设计一个控制策略的“领导者”代理,羊群的“追随者”代理,通过排斥的相互作用,尽可能快地在一个强连接图的目标概率分布。领导者控制策略是群分布的函数,群分布根据常差分方程形式的平均场模型随时间演化。该策略依赖于每个图顶点上的代理种群,而不是单个代理活动,简化了领导者所需的观察,并使控制策略能够随代理数量而扩展。两个时间差学习算法,SARSA和Q学习,用于生成领导者控制策略的基础上的追随者代理分布和领导者的位置在图中。使用对应于4个顶点的网格图的仿真环境来训练和验证10到100个追随者代理种群的控制策略。最后,使用在100个模拟代理上训练的控制策略,成功地将10个小型机器人的物理群重新分配到4个空间区域之间的目标分布。

英文摘要:

In this paper, we present a reinforcement learning approach to designing a control policy for a "leader" agent that herds a swarm of "follower" agents, via repulsive interactions, as quickly as possible to a target probability distribution over a strongly connected graph. The leader control policy is a function of the swarm distribution, which evolves over time according to a mean-field model in the form of an ordinary difference equation. The dependence of the policy on agent populations at each graph vertex, rather than on individual agent activity, simplifies the observations required by the leader and enables the control strategy to scale with the number of agents. Two Temporal-Difference learning algorithms, SARSA and Q-Learning, are used to generate the leader control policy based on the follower agent distribution and the leader's location on the graph. A simulation environment corresponding to a grid graph with 4 vertices was used to train and validate the control policies for follower agent populations ranging from 10 to 100. Finally, the control policies trained on 100 simulated agents were used to successfully redistribute a physical swarm of 10 small robots to a target distribution among 4 spatial regions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑