arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.08976cs.RO
收藏

通过李雅普诺夫函数学习生成稳定无冲突策略

Generating Stable and Collision-Free Policies through Lyapunov Function Learning

McGill University(麦吉尔大学)

Alexandre Coulombe, Hsiu-Chin Lin

摘要:

对快速可靠的机器人部署的需求正在上升。模仿学习(IL)已经变得流行,用于从一组演示中产生运动规划策略。然而,IL中的许多方法不能保证产生稳定的策略。生成的策略可能不会收敛到机器人目标,从而降低可靠性,并且可能与其环境冲突,从而降低系统的安全性。动态系统稳定估计(SEDS)通过在学习过程中约束李雅普诺夫稳定性准则来产生稳定的策略,但李雅普诺夫候选函数必须手动选择。在这项工作中,我们提出了一种新的方法学习李雅普诺夫函数和政策,使用一个单一的神经网络模型。该方法可以配备用于凸对象对的避障模块,以保证没有碰撞。我们证明了我们的方法能够在几个模拟环境中找到策略,并转移到现实世界的场景中。

英文摘要:

The need for rapid and reliable robot deployment is on the rise. Imitation Learning (IL) has become popular for producing motion planning policies from a set of demonstrations. However, many methods in IL are not guaranteed to produce stable policies. The generated policy may not converge to the robot target, reducing reliability, and may collide with its environment, reducing the safety of the system. Stable Estimator of Dynamic Systems (SEDS) produces stable policies by constraining the Lyapunov stability criteria during learning, but the Lyapunov candidate function had to be manually selected. In this work, we propose a novel method for learning a Lyapunov function and a policy using a single neural network model. The method can be equipped with an obstacle avoidance module for convex object pairs to guarantee no collisions. We demonstrated our method is capable of finding policies in several simulation environments and transfer to a real-world scenario.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑