arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.11751cs.CVcs.LG
收藏

用于人体运动合成的对抗性注意

Adversarial Attention for Human Motion Synthesis

University of Glasgow(格拉斯哥大学)

Matthew Malek-Podjaski, Fani Deligianni

摘要:

从人机交互到娱乐、虚拟现实和医疗保健,分析人体运动是许多学科感兴趣的核心课题。深度学习在实时捕捉人体姿势方面取得了令人印象深刻的成果。另一方面,由于受试者间的高度可变性,人体运动分析模型通常由于在诸如医疗保健等领域中可用的非常有限的专业数据集而无法概括来自看不见的受试者的数据。然而,获取人体运动数据集是非常耗时,具有挑战性和昂贵的。因此,人体运动合成是深度学习和计算机视觉中的一个关键研究问题。我们提出了一种新的可控人体运动合成方法,通过应用基于注意力的概率深度对抗模型进行端到端训练。我们表明,我们可以通过使用对抗性注意力在短时间和长时间范围内生成合成人体运动。此外,我们还表明,在真实数据不足的情况下,我们可以通过用合成运动补充现有数据集来提高深度学习模型的分类性能。

英文摘要:

Analysing human motions is a core topic of interest for many disciplines, from Human-Computer Interaction, to entertainment, Virtual Reality and healthcare. Deep learning has achieved impressive results in capturing human pose in real-time. On the other hand, due to high inter-subject variability, human motion analysis models often suffer from not being able to generalise to data from unseen subjects due to very limited specialised datasets available in fields such as healthcare. However, acquiring human motion datasets is highly time-consuming, challenging, and expensive. Hence, human motion synthesis is a crucial research problem within deep learning and computer vision. We present a novel method for controllable human motion synthesis by applying attention-based probabilistic deep adversarial models with end-to-end training. We show that we can generate synthetic human motion over both short- and long-time horizons through the use of adversarial attention. Furthermore, we show that we can improve the classification performance of deep learning models in cases where there is inadequate real data, by supplementing existing datasets with synthetic motions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑