arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.14256cs.ROcs.AIcs.LG
收藏

切换线性动态模型的学习反应和预测微分控制器

Learning Reactive and Predictive Differentiable Controllers for Switching Linear Dynamical Models

Carnegie Mellon University(卡内基梅隆大学);School of Computer Science(计算机科学学院);Robotics Institute(机器人研究所)

Saumya Saxena, Alex LaGrassa, Oliver Kroemer

摘要:

人类利用环境和自己身体的动态来完成具有挑战性的任务,例如在走过物体时抓住物体,或者推开墙壁转弯。这些任务通常涉及机器人进行和断开接触时的切换动力学。学习这些动力学是一个具有挑战性的问题,并且容易导致模型不准确,特别是在接触区域附近。在这项工作中,我们提出了一个框架,从专家演示学习复合动力学行为。我们学习了一个开关线性动力学模型,其中接触编码在开关条件中,作为我们系统动力学的近似。然后,我们使用离散时间LQR作为数据有效学习控制的可微策略类,以开发一种控制策略,该控制策略在多个动态模式下运行,并考虑到由于接触引起的不连续性。除了预测与环境的相互作用外,我们的策略还能有效地对不准确的预测做出反应,例如意外的接触。通过模拟和现实世界的实验,我们证明了学习行为的泛化到不同的场景和鲁棒性模型在执行过程中的不准确性。

英文摘要:

Humans leverage the dynamics of the environment and their own bodies to accomplish challenging tasks such as grasping an object while walking past it or pushing off a wall to turn a corner. Such tasks often involve switching dynamics as the robot makes and breaks contact. Learning these dynamics is a challenging problem and prone to model inaccuracies, especially near contact regions. In this work, we present a framework for learning composite dynamical behaviors from expert demonstrations. We learn a switching linear dynamical model with contacts encoded in switching conditions as a close approximation of our system dynamics. We then use discrete-time LQR as the differentiable policy class for data-efficient learning of control to develop a control strategy that operates over multiple dynamical modes and takes into account discontinuities due to contact. In addition to predicting interactions with the environment, our policy effectively reacts to inaccurate predictions such as unanticipated contacts. Through simulation and real world experiments, we demonstrate generalization of learned behaviors to different scenarios and robustness to model inaccuracies during execution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑