利用概率自动机推断动作的时间组合
Inferring Temporal Compositions of Actions Using Probabilistic Automata
摘要:
本文提出了一个框架来识别视频中原子动作的时间组成。具体来说,我们建议表达时间组成的动作作为语义正则表达式,并推导出一个推理框架,使用概率自动机来识别复杂的动作,满足这些表达式的输入视频功能。我们的方法是从现有的作品,无论是预测长期复杂的活动,无序的原子动作集,或检索视频使用自然语言句子不同。相反,所提出的方法允许仅使用预先训练的动作分类器来识别复杂的细粒度活动,而不需要任何额外的数据、注释或神经网络训练。为了评估我们的方法的潜力,我们提供了合成数据集和具有挑战性的真实动作识别数据集,如MultiTHUMOS和Charades的实验。我们的结论是,所提出的方法可以扩展国家的最先进的原始动作分类器,大大更复杂的活动,没有大的性能下降。
英文摘要:
This paper presents a framework to recognize temporal compositions of atomic actions in videos. Specifically, we propose to express temporal compositions of actions as semantic regular expressions and derive an inference framework using probabilistic automata to recognize complex actions as satisfying these expressions on the input video features. Our approach is different from existing works that either predict long-range complex activities as unordered sets of atomic actions, or retrieve videos using natural language sentences. Instead, the proposed approach allows recognizing complex fine-grained activities using only pretrained action classifiers, without requiring any additional data, annotations or neural network training. To evaluate the potential of our approach, we provide experiments on synthetic datasets and challenging real action recognition datasets, such as MultiTHUMOS and Charades. We conclude that the proposed approach can extend state-of-the-art primitive action classifiers to vastly more complex activities without large performance degradation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。