arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.07355cs.CVcs.LG
收藏

成功-失败动作识别

Win-Fail Action Recognition

University of Nevada, Las Vegas(内华达大学拉斯维加斯分校)

Paritosh Parmar, Brendan Morris

摘要:

当前的视频/动作理解系统在大型识别任务上表现出令人印象深刻的性能。然而,他们可能只限于学习识别时空模式,而不是试图彻底理解这些行为。为了促进对视频更真实、更深入的理解,我们引入了成败动作识别的任务--区分各种活动中成功和失败的尝试。我们引入了第一个配对的赢-失败动作理解数据集,其中包含来自以下领域的样本:“一般特技”,“互联网赢-失败”,“特技射击”和“派对游戏”。“与现有的动作识别数据集不同,类内变化很高,这使得任务具有挑战性,但可行。我们系统地分析了与原型动作识别网络和一个新的视频检索任务的输赢任务/数据集的特点。虽然目前的动作识别方法在我们的任务/数据集上运行良好,但它们仍然存在很大的差距,无法实现高性能。我们希望激励更多的工作,以真正理解行动/视频。数据集可从https://github.com/ParitoshParmar/Win-Fail-Action-Recognition获得。

英文摘要:

Current video/action understanding systems have demonstrated impressive performance on large recognition tasks. However, they might be limiting themselves to learning to recognize spatiotemporal patterns, rather than attempting to thoroughly understand the actions. To spur progress in the direction of a truer, deeper understanding of videos, we introduce the task of win-fail action recognition -- differentiating between successful and failed attempts at various activities. We introduce a first of its kind paired win-fail action understanding dataset with samples from the following domains: "General Stunts," "Internet Wins-Fails," "Trick Shots," and "Party Games." Unlike existing action recognition datasets, intra-class variation is high making the task challenging, yet feasible. We systematically analyze the characteristics of the win-fail task/dataset with prototypical action recognition networks and a novel video retrieval task. While current action recognition methods work well on our task/dataset, they still leave a large gap to achieve high performance. We hope to motivate more work towards the true understanding of actions/videos. Dataset will be available from https://github.com/ParitoshParmar/Win-Fail-Action-Recognition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑