arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.05342cs.CVcs.HCcs.LGcs.MM

3D attention mechanism for fine-grained classification of table tennis strokes using a Twin Spatio-Temporal Convolutional Neural Networks

University of Bordeaux(波尔多大学);CNRS(法国国家科学研究中心);Bordeaux INP(波尔多国立高等物理、数学与信息学院);University of La Rochelle(拉罗谢尔大学)

Pierre-Etienne Martin, Jenny Benois-Pineau, Renaud Péteri, Julien Morlier

英文摘要:

The paper addresses the problem of recognition of actions in video with low inter-class variability such as Table Tennis strokes. Two stream, "twin" convolutional neural networks are used with 3D convolutions both on RGB data and optical flow. Actions are recognized by classification of temporal windows. We introduce 3D attention modules and examine their impact on classification efficiency. In the context of the study of sportsmen performances, a corpus of the particular actions of table tennis strokes is considered. The use of attention blocks in the network speeds up the training step and improves the classification scores up to 5% with our twin model. We visualize the impact on the obtained features and notice correlation between attention and player movements and position. Score comparison of state-of-the-art action classification method and proposed approach with attentional blocks is performed on the corpus. Proposed model with attention blocks outperforms previous model without them and our baseline.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑