arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.12932cs.LGcs.CV
收藏

LagNetViP:一种用于视频预测的拉格朗日神经网络

LagNetViP: A Lagrangian Neural Network for Video Prediction

Princeton University(普林斯顿大学)

Christine Allen-Blanchette, Sushant Veer, Anirudha Majumdar, Naomi Ehrich Leonard

摘要:

视频预测的主导范例依赖于不透明的过渡模型,其中运动方程和系统的基本物理量都不容易推断。由牛顿第二定律定义的运动方程描述了物理系统状态的时间演化,因此可以应用于确定未来的系统状态。在本文中,我们介绍了一种视频预测模型,其中运动方程是从底层物理量的学习表示显式构造的。为了实现这一点,我们同时学习低维状态表示和系统拉格朗日。拉格朗日的动能和势能项是明确建模和低维的运动方程,明确使用欧拉-拉格朗日方程。我们证明了这种方法在修改后的OpenAI健身房Pendulum-v0和Acrobot环境中渲染的图像序列上进行视频预测的有效性。

英文摘要:

The dominant paradigms for video prediction rely on opaque transition models where neither the equations of motion nor the underlying physical quantities of the system are easily inferred. The equations of motion, as defined by Newton's second law, describe the time evolution of a physical system state and can therefore be applied toward the determination of future system states. In this paper, we introduce a video prediction model where the equations of motion are explicitly constructed from learned representations of the underlying physical quantities. To achieve this, we simultaneously learn a low-dimensional state representation and system Lagrangian. The kinetic and potential energy terms of the Lagrangian are distinctly modelled and the low-dimensional equations of motion are explicitly constructed using the Euler-Lagrange equations. We demonstrate the efficacy of this approach for video prediction on image sequences rendered in modified OpenAI gym Pendulum-v0 and Acrobot environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑