arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.13124cs.ROcs.AIcs.LG
收藏

机器人群体的仿真研究

Simulation of robot swarms for learning communication-aware coordination

Università della Svizzera Italiana(瑞士意大利语大学)

Giorgia Adorni

摘要:

机器人的研究一直集中在合作的多智能体问题,其中智能体必须一起工作和通信,以实现一个共同的目标。为了应对这一挑战,我们探索模仿学习算法。这些方法通过观察专家的演示来学习控制器,例如集中式全知控制器的行为,它可以感知整个环境,包括所有代理的状态和观察。执行任务与完整的知识系统的状态是相对容易的,但集中式的解决方案可能是不可行的,在真实的场景中,因为代理没有直接存取的状态,但只有他们的意见。为了克服这个问题,我们训练端到端神经网络,这些神经网络将从全知的集中式控制器获得的局部观测值作为输入,即,代理的传感器读数和接收到的通信,产生要执行的动作和要发送的通信作为输出。本研究集中在两个合作的任务,使用分布式控制器:均匀分布的机器人在空间和着色的基础上,他们的位置相对于他人。虽然需要在代理之间进行显式的消息交换来解决第二个任务,但在第一个任务中,通信协议是不必要的,尽管它可以提高性能。实验在Enki中运行,Enki是一个高性能的平面机器人开源模拟器,它为在平面上进化的机器人提供碰撞检测和有限的物理支持。此外,它可以模拟机器人组的速度比实时快数百倍。结果表明,应用通信策略如何提高分布式模型的性能,让它几乎像专家控制器一样精确和快速地决定采取哪些行动。

英文摘要:

Robotics research has been focusing on cooperative multi-agent problems, where agents must work together and communicate to achieve a shared objective. To tackle this challenge, we explore imitation learning algorithms. These methods learn a controller by observing demonstrations of an expert, such as the behaviour of a centralised omniscient controller, which can perceive the entire environment, including the state and observations of all agents. Performing tasks with complete knowledge of the state of a system is relatively easy, but centralised solutions might not be feasible in real scenarios since agents do not have direct access to the state but only to their observations. To overcome this issue, we train end-to-end Neural Networks that take as input local observations obtained from an omniscient centralised controller, i.e., the agents' sensor readings and the communications received, producing as output the action to be performed and the communication to be transmitted. This study concentrates on two cooperative tasks using a distributed controller: distributing the robots evenly in space and colouring them based on their position relative to others. While an explicit exchange of messages between the agents is required to solve the second task, in the first one, a communication protocol is unnecessary, although it may increase performance. The experiments are run in Enki, a high-performance open-source simulator for planar robots, which provides collision detection and limited physics support for robots evolving on a flat surface. Moreover, it can simulate groups of robots hundreds of times faster than real-time. The results show how applying a communication strategy improves the performance of the distributed model, letting it decide which actions to take almost as precisely and quickly as the expert controller.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑