arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.02376cs.CVcs.HC
收藏

基于时空潜在动作单元的Skills鲁棒事件检测

Robust Event Detection based on Spatio-Temporal Latent Action Unit using Skeletal Information

Technical University of Munich(慕尼黑工业大学)

Hao Xing, Yuxuan Xue, Mingchuan Zhou, Darius Burschka

摘要:

本文提出了一种新的字典学习方法来检测事件的动作,从RGBD视频提取的骨架信息。事件行为被表示为多个潜在原子,由潜在的空间和时间属性组成。我们在跌倒事件检测的例子中执行该方法。骨架帧聚类的初始K-均值方法。每个骨架帧都被分配了一个不同的权重参数,并被输入到我们的渐进在线字典学习(GODL)算法中。在训练过程中,离群帧将通过减少与成本成反比的权重来逐渐过滤。为了严格区分事件动作和相似动作,鲁棒地获取其动作单元,我们为每个子动作建立了一个潜在的单元时间结构。我们在NTURGB+D数据集的部分数据上评估了所提出的方法,该数据集包括209个跌倒视频,405个地面提升视频,420个坐下视频和280个46个其他动作的视频。我们提出的实验验证所取得的准确率,召回率和精度。与其他现有的字典学习方法相比,我们的方法在人体跌倒事件检测的精确度和准确度上取得了最好的性能。随着噪声比的增加,我们的方法仍然是最高的精度和最低的方差。

英文摘要:

This paper propose a novel dictionary learning approach to detect event action using skeletal information extracted from RGBD video. The event action is represented as several latent atoms and composed of latent spatial and temporal attributes. We perform the method at the example of fall event detection. The skeleton frames are clustered by an initial K-means method. Each skeleton frame is assigned with a varying weight parameter and fed into our Gradual Online Dictionary Learning (GODL) algorithm. During the training process, outlier frames will be gradually filtered by reducing the weight that is inversely proportional to a cost. In order to strictly distinguish the event action from similar actions and robustly acquire its action unit, we build a latent unit temporal structure for each sub-action. We evaluate the proposed method on parts of the NTURGB+D dataset, which includes 209 fall videos, 405 ground-lift videos, 420 sit-down videos, and 280 videos of 46 otheractions. We present the experimental validation of the achieved accuracy, recall and precision. Our approach achieves the bestperformance on precision and accuracy of human fall event detection, compared with other existing dictionary learning methods. With increasing noise ratio, our method remains the highest accuracy and the lowest variance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑