arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.08875cs.CV
收藏

一种概率半监督的多任务人体活动建模方法

A Probabilistic Semi-Supervised Approach to Multi-Task Human Activity Modeling

KTH Royal Institute of Technology(瑞典皇家理工学院)

Judith Bütepage, Hedvig Kjellström, Danica Kragic

摘要:

人的行为是一个连续的随机时空过程,它受语义行为和启示以及潜在因素的制约。因此,基于视频的人类活动建模涉及许多任务,例如推断当前和未来的语义标签,预测未来的连续观察以及想象可能的未来标签和特征序列。在本文中,我们提出了一个半监督概率深度潜变量模型,可以表示离散标签和连续观测以及随时间的潜在动态。这允许模型一次解决多个任务,而无需显式微调。在这里,我们专注于动作分类,检测,预测和预测,以及运动预测和合成的基础上记录与Kinect的三维人体活动数据的任务。我们进一步扩展了模型,以捕获分层标签结构,并对多个实体(如人和对象)之间的依赖关系进行建模。我们的实验表明,我们的人类活动建模的原则性方法可用于检测当前和预测未来的语义标签,并预测和合成未来的标签和特征序列。当将我们的模型与最先进的方法进行比较时,这些方法是专门为例如动作分类而设计的,我们发现我们的概率公式优于这些任务特定的模型。

英文摘要:

Human behavior is a continuous stochastic spatio-temporal process which is governed by semantic actions and affordances as well as latent factors. Therefore, video-based human activity modeling is concerned with a number of tasks such as inferring current and future semantic labels, predicting future continuous observations as well as imagining possible future label and feature sequences. In this paper we present a semi-supervised probabilistic deep latent variable model that can represent both discrete labels and continuous observations as well as latent dynamics over time. This allows the model to solve several tasks at once without explicit fine-tuning. We focus here on the tasks of action classification, detection, prediction and anticipation as well as motion prediction and synthesis based on 3D human activity data recorded with Kinect. We further extend the model to capture hierarchical label structure and to model the dependencies between multiple entities, such as a human and objects. Our experiments demonstrate that our principled approach to human activity modeling can be used to detect current and anticipate future semantic labels and to predict and synthesize future label and feature sequences. When comparing our model to state-of-the-art approaches, which are specifically designed for e.g. action classification, we find that our probabilistic formulation outperforms or is comparable to these task specific models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑