arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.18519cs.ROcs.MA
收藏

一种注入Talent的策略梯度方法用于多机器人系统形态与任务分配行为的高效协同设计

A Talent-infused Policy-gradient Approach to Efficient Co-Design of Morphology and Task Allocation Behavior of Multi-Robot Systems

University at Buffalo(布法罗大学)

Prajit KrisshnaKumar, Steve Paul, Souma Chowdhury

AI总结:

针对多机器人系统形态与行为协同设计问题,本文提出注入Talent的策略梯度方法,通过分解问题、利用Talent指标帕累托前沿及图强化学习优化,在洪水响应MRTA任务中优于传统方法,揭示了形态对集体行为的影响。

摘要:

在多机器人或群体系统中观察到的有趣且高效的集体行为源于机器人的个体行为。个体机器人行为的功能空间反过来又受到机器人形态或物理设计的塑造或约束。因此,多机器人系统的全部潜力可以通过同时优化个体机器人的形态和行为来实现,这一过程由环境对其集体性能的反馈提供信息,而非像传统方法那样将形态和行为选择分开或按顺序处理。本文提出了一种高效的并发设计(协同设计)方法,以探索这种潜力并理解形态选择如何影响集体行为,特别是在聚焦于洪水响应场景的多机器人任务分配(MRTA)问题中,其中个体行为通过图强化学习设计。这种方法的计算效率归功于一种新的近乎精确的分解方式,将协同设计问题分解为一系列更简单的优化和学习问题。这通过以下两点实现:i)识别并使用代表形态依赖机器人能力的Talent指标的帕累托前沿;ii)学习Talent最佳权衡的选择和个体机器人策略,以共同最大化MRTA性能。将该方法应用于多无人机洪水响应用例,结果表明协同设计的结果轻松优于顺序设计基线。在比较针对类似操作的协同设计单机器人系统与协同设计多机器人系统时,还观察到形态和学习行为的显著差异。

英文摘要:

Interesting and efficient collective behavior observed in multi-robot or swarm systems emerges from the individual behavior of the robots. The functional space of individual robot behaviors is in turn shaped or constrained by the robot's morphology or physical design. Thus the full potential of multi-robot systems can be realized by concurrently optimizing the morphology and behavior of individual robots, informed by the environment's feedback about their collective performance, as opposed to treating morphology and behavior choices disparately or in sequence (the classical approach). This paper presents an efficient concurrent design or co-design method to explore this potential and understand how morphology choices impact collective behavior, particularly in an MRTA problem focused on a flood response scenario, where the individual behavior is designed via graph reinforcement learning. Computational efficiency in this case is attributed to a new way of near exact decomposition of the co-design problem into a series of simpler optimization and learning problems. This is achieved through i) the identification and use of the Pareto front of Talent metrics that represent morphology-dependent robot capabilities, and ii) learning the selection of Talent best trade-offs and individual robot policy that jointly maximizes the MRTA performance. Applied to a multi-unmanned aerial vehicle flood response use case, the co-design outcomes are shown to readily outperform sequential design baselines. Significant differences in morphology and learned behavior are also observed when comparing co-designed single robot vs. co-designed multi-robot systems for similar operations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑