通过观察专家来推断和学习多机器人策略
Inferring and Learning Multi-Robot Policies by Observing an Expert
摘要:
我们提出了一种技术,学习如何解决多机器人任务,需要通过观察一个专家系统执行相同的任务与外部环境的相互作用。我们定义的专家系统作为一个团队的机器人配备了一个库的控制器,每个设计来解决一个特定的任务,由一个专家的政策,适当地选择控制器的机器人和环境的状态的基础上进行监督。目标是一个未经训练的机器人团队(即,模拟器系统),其配备有相同的控制器库,但是不知道专家策略,以执行任务,其性能与专家系统的性能相当。根据专家系统的未注释观测,使用多假设过滤技术来估计由专家策略执行的各个控制器。然后,估计的控制器和环境状态的历史被用来训练一个神经网络政策的模仿者系统。考虑到周边保护方案的差分驱动机器人的团队,我们表明,学到的政策赋予模仿者系统的性能媲美的专家系统。
英文摘要:
We present a technique for learning how to solve a multi-robot mission that requires interaction with an external environment by observing an expert system executing the same mission. We define the expert system as a team of robots equipped with a library of controllers, each designed to solve a specific task, supervised by an expert policy that appropriately selects controllers based on the states of robots and environment. The objective is for an un-trained team of robots (i.e., imitator system) equipped with the same library of controllers, but agnostic to the expert policy, to execute the mission, with performances comparable to those of the expert system. From un-annotated observations of the expert system, a multi-hypothesis filtering technique is used to estimate individual controllers executed by the expert policy. Then, the history of estimated controllers and environmental states is used to train a neural network policy for the imitator system. Considering a perimeter protection scenario on a team of differential-drive robots, we show that the learned policy endows the imitator system with performances comparable to those of the expert system.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。