跨越现实差距:可转移性方法简介
Crossing the Reality Gap: a Short Introduction to the Transferability Approach
摘要:
在机器人技术中,无梯度优化算法(例如进化算法)通常只用于仿真,因为它们需要评估许多候选解。然而,在仿真中获得的解决方案往往不能很好地工作在真实设备上。可移植性方法旨在通过\emph{making the optimization algorithm aware of the limits of the simulation}跨越仿真和现实之间的这一差距。在本文中,我们首先描述的可转移性功能,解决方案的描述符映射到一个分数代表如何以及模拟器匹配的现实。然后,我们表明,这个功能可以使用回归算法和一些实验与真实的设备。我们的研究结果是支持一个简单的四足机器人,其控制参数进行了优化的现实差距的广泛研究。特别是,我们在现实和模拟中映射了整个搜索空间,以了解适应度景观之间的差异。
英文摘要:
In robotics, gradient-free optimization algorithms (e.g. evolutionary algorithms) are often used only in simulation because they require the evaluation of many candidate solutions. Nevertheless, solutions obtained in simulation often do not work well on the real device. The transferability approach aims at crossing this gap between simulation and reality by \emph{making the optimization algorithm aware of the limits of the simulation}. In the present paper, we first describe the transferability function, that maps solution descriptors to a score representing how well a simulator matches the reality. We then show that this function can be learned using a regression algorithm and a few experiments with the real devices. Our results are supported by an extensive study of the reality gap for a simple quadruped robot whose control parameters are optimized. In particular, we mapped the whole search space in reality and in simulation to understand the differences between the fitness landscapes.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。