arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.17865cs.CVcs.AInlin.CD
收藏

基于视觉的三维运动目标非线性动力学发现

Vision-based Discovery of Nonlinear Dynamics for 3D Moving Target

Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Engineering Science, University of Chinese Academy of Sciences(中国科学院大学工程科学学院)

Zitong Zhang, Yang Liu, Hao Sun

AI总结:

提出一种基于视觉的方法,通过相机原始视频自动发现三维运动目标的非线性动力学控制方程,包含目标跟踪、坐标变换重建和稀疏回归三个模块,有效应对噪声和数据缺失挑战。

摘要:

数据驱动的控制方程发现在许多科学和工程领域引起了广泛关注。现有研究主要集中在基于系统状态(例如轨迹)的直接测量来揭示控制非线性动力学的方程。对于直接从视频中提取三维空间中运动目标的动力学控制规律,目前投入的努力有限。为此,我们提出了一种基于视觉的方法,通过一组相机记录的原始视频,自动揭示三维运动目标的非线性动力学控制方程。该方法由三个关键模块组成:(1)目标跟踪模块,用于提取每个视频中运动目标的平面像素运动;(2)基于罗德里格斯旋转公式的坐标变换学习模块,用于重建相对于预定义参考点的三维坐标;(3)样条增强的基于库的稀疏回归器,用于揭示潜在的动力学控制规律。该框架能够有效处理与测量数据相关的挑战,例如视频中的噪声、导致数据丢失的目标跟踪不精确等。通过考虑不同非线性动力学的多组合成视频,验证了我们方法的有效性。

英文摘要:

Data-driven discovery of governing equations has kindled significant interests in many science and engineering areas. Existing studies primarily focus on uncovering equations that govern nonlinear dynamics based on direct measurement of the system states (e.g., trajectories). Limited efforts have been placed on distilling governing laws of dynamics directly from videos for moving targets in a 3D space. To this end, we propose a vision-based approach to automatically uncover governing equations of nonlinear dynamics for 3D moving targets via raw videos recorded by a set of cameras. The approach is composed of three key blocks: (1) a target tracking module that extracts plane pixel motions of the moving target in each video, (2) a Rodrigues' rotation formula-based coordinate transformation learning module that reconstructs the 3D coordinates with respect to a predefined reference point, and (3) a spline-enhanced library-based sparse regressor that uncovers the underlying governing law of dynamics. This framework is capable of effectively handling the challenges associated with measurement data, e.g., noise in the video, imprecise tracking of the target that causes data missing, etc. The efficacy of our method has been demonstrated through multiple sets of synthetic videos considering different nonlinear dynamics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑