arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.09834cs.ROcs.GR
收藏

基于微分物理仿真的实时的模型预测控制与系统辨识

Real-time Model Predictive Control and System Identification Using Differentiable Physics Simulation

University of Hong Kong(香港大学);Stanford University(斯坦福大学)

Sirui Chen, Keenon Werling, Albert Wu, C. Karen Liu

摘要:

在模拟环境中开发机器人控制器是有利的,但将控制器转移到目标环境中存在挑战,通常被称为“模拟与真实的差距”。我们提出了一种方法,用于在将机器人部署到动态变化的目标环境后,不断改进建模和控制。我们开发了一个可微物理仿真框架,该框架同时执行在线系统辨识和最优控制,使用来自目标环境的实时的观测。为了确保鲁棒的系统辨识对噪声观测,我们设计了一种算法来评估我们估计的参数的置信度,使用数值分析的动态方程。为了确保实时的最优控制,我们自适应地安排未来的优化窗口,以便优化的动作可以比它们被消耗的更快地被补充,同时尽可能地保持最新的传感器信息。基于不断改进的模型的不断重新规划使机器人能够快速适应不断变化的环境,并以最有效的方式利用真实世界的数据。由于一个快速可微的物理模拟器,优化系统辨识和控制可以有效地解决机器人在实时的操作。我们证明了我们的方法在一组模拟的例子,并表明我们的结果是有利的基线方法相比。

英文摘要:

Developing robot controllers in a simulated environment is advantageous but transferring the controllers to the target environment presents challenges, often referred to as the "sim-to-real gap". We present a method for continuous improvement of modeling and control after deploying the robot to a dynamically-changing target environment. We develop a differentiable physics simulation framework that performs online system identification and optimal control simultaneously, using the incoming observations from the target environment in real time. To ensure robust system identification against noisy observations, we devise an algorithm to assess the confidence of our estimated parameters, using numerical analysis of the dynamic equations. To ensure real-time optimal control, we adaptively schedule the optimization window in the future so that the optimized actions can be replenished faster than they are consumed, while staying as up-to-date with new sensor information as possible. The constant re-planning based on a constantly improved model allows the robot to swiftly adapt to the changing environment and utilize real-world data in the most sample-efficient way. Thanks to a fast differentiable physics simulator, the optimization for both system identification and control can be solved efficiently for robots operating in real time. We demonstrate our method on a set of examples in simulation and show that our results are favorable compared to baseline methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑