arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.01888cs.CVcs.LGeess.IV
收藏

MoVi:一个大型多用途运动和视频数据集

MoVi: A Large Multipurpose Motion and Video Dataset

York University(约克大学);Queen’s University(女王大学);University of Pennsylvania(宾夕法尼亚大学)

Saeed Ghorbani, Kimia Mahdaviani, Anne Thaler, Konrad Kording, Douglas James Cook, Gunnar Blohm, Nikolaus F. Troje

摘要:

人体运动既是一个深入研究的领域,也是许多应用程序(如角色动画)的基础。对于许多应用程序来说,从视频中识别运动或分析运动数据集至关重要。在这里,我们介绍了一个新的人类运动和视频数据集MoVi,我们公开提供。它包含60名女性和30名男性演员,表演20个预先定义的日常动作和体育运动,以及一个自选动作。在五轮捕获中,使用不同的硬件系统记录相同的演员和动作,包括光学运动捕获系统,摄像机和惯性测量单元(IMU)。在一些拍摄回合中,演员们穿着自然的衣服被记录下来,而在其他回合中,他们穿着最少的衣服。总的来说,我们的数据集包含9小时的运动捕捉数据,17小时的视频数据,来自4个不同的视角(包括一个手持摄像头),以及6.6小时的IMU数据。在本文中,我们描述了数据集是如何收集和后处理的,我们提出了最先进的估计骨骼运动和全身形状变形与骨骼运动。我们讨论了这个数据集可以实现的潜在研究的例子。

英文摘要:

Human movements are both an area of intense study and the basis of many applications such as character animation. For many applications, it is crucial to identify movements from videos or analyze datasets of movements. Here we introduce a new human Motion and Video dataset MoVi, which we make available publicly. It contains 60 female and 30 male actors performing a collection of 20 predefined everyday actions and sports movements, and one self-chosen movement. In five capture rounds, the same actors and movements were recorded using different hardware systems, including an optical motion capture system, video cameras, and inertial measurement units (IMU). For some of the capture rounds, the actors were recorded when wearing natural clothing, for the other rounds they wore minimal clothing. In total, our dataset contains 9 hours of motion capture data, 17 hours of video data from 4 different points of view (including one hand-held camera), and 6.6 hours of IMU data. In this paper, we describe how the dataset was collected and post-processed; We present state-of-the-art estimates of skeletal motions and full-body shape deformations associated with skeletal motion. We discuss examples for potential studies this dataset could enable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑