arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.20041cs.ROcond-mat.soft
收藏

反事实奖励利用独立控制的群体微型机器人促进集体运输

Counterfactual rewards promote collective transport using individually controlled swarm microrobots

University of Konstanz(康斯坦茨大学);Centre for the Advanced Study of Collective Behaviour(集体行为高级研究中心);The Abdus Salam International Centre for Theoretical Physics (ICTP)(阿卜杜勒·萨拉姆国际理论物理中心(ICTP));Area Science Park(区域科学园)

Veit-Lorenz Heuthe, Emanuele Panizon, Hongri Gu, Clemens Bechinger

AI总结:

针对独立控制微型机器人实现集体运输的挑战,研究采用多智能体强化学习与反事实奖励机制,为多达200个微型机器人生成高效鲁棒的控制策略,实现任意位置和方向的货物集体运输,有望推动微型机器和药物递送等应用。

摘要:

群体机器人提供了超越单机能力执行复杂任务的迷人机遇。正如蚁群集体移动庞大物体,基于局部感知的个体策略也能在机器人群体中涌现类似功能。然而,用独立控制的微型机器人实现集体功能极具挑战,原因在于其微米级尺寸、大量自由度、相对于推进速度的强烈热噪声、相邻微型机器人间复杂的物理耦合以及表面碰撞。在此,我们实施多智能体强化学习(MARL)为多达200个微型机器人生成控制策略,其运动由激光点独立控制。在学习过程中,我们采用所谓的反事实奖励,自动将信用分配给各个微型机器人,从而实现快速且无偏的训练。借助这种高效的奖励机制,群体微型机器人学会了将大型货物集体运输至任意位置和方向,类似于蚁群。我们证明,这种灵活且通用的群体机器人系统对群体规模变化、故障单元的存在以及环境噪声具有鲁棒性。此类控制策略有望实现移动微型机器、可编程药物递送胶囊及其他先进芯片实验室应用的复杂自动化装配。

英文摘要:

Swarm robots offer fascinating opportunities to perform complex tasks beyond the capabilities of individual machines. Just as a swarm of ants collectively moves a large object, similar functions can emerge within a group of robots through individual strategies based on local sensing. However, realizing collective functions with individually controlled microrobots is particularly challenging due to their micrometer size, large number of degrees of freedom, strong thermal noise relative to the propulsion speed, complex physical coupling between neighboring microrobots, and surface collisions. Here, we implement Multi-Agent Reinforcement Learning (MARL) to generate a control strategy for up to 200 microrobots whose motions are individually controlled by laser spots. During the learning process, we employ so-called counterfactual rewards that automatically assign credit to the individual microrobots, which allows for fast and unbiased training. With the help of this efficient reward scheme, swarm microrobots learn to collectively transport a large cargo object to an arbitrary position and orientation, similar to ant swarms. We demonstrate that this flexible and versatile swarm robotic system is robust to variations in group size, the presence of malfunctioning units, and environmental noise. Such control strategies can potentially enable complex and automated assembly of mobile micromachines, programmable drug delivery capsules, and other advanced lab-on-a-chip applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑