RED:增强的行动预测编码器-解码器网络
RED: Reinforced Encoder-Decoder Networks for Action Anticipation
摘要:
动作预测的目的是在动作发生之前发现它。机器人和监控领域的许多现实应用都与这种预测能力有关。当前的方法通过首先预测未来帧的视觉表示,然后将预期的表示分类为动作来解决这个问题。然而,预测是基于单一的过去框架的表征,忽略了历史的趋势。此外,它只能预测一个固定的未来时间。我们提出了一个加强编码器-解码器(RED)网络的行动预期。RED将多个历史表示作为输入,并学习预测未来表示的序列。RED的一个突出方面是采用强化模块来提供序列级监督;奖励函数旨在鼓励系统尽早做出正确的预测。我们在TVSeries,THUMOS-14和TV-Human-Interaction数据集上测试RED的动作预测,并在所有数据集上实现最先进的性能。
英文摘要:
Action anticipation aims to detect an action before it happens. Many real world applications in robotics and surveillance are related to this predictive capability. Current methods address this problem by first anticipating visual representations of future frames and then categorizing the anticipated representations to actions. However, anticipation is based on a single past frame's representation, which ignores the history trend. Besides, it can only anticipate a fixed future time. We propose a Reinforced Encoder-Decoder (RED) network for action anticipation. RED takes multiple history representations as input and learns to anticipate a sequence of future representations. One salient aspect of RED is that a reinforcement module is adopted to provide sequence-level supervision; the reward function is designed to encourage the system to make correct predictions as early as possible. We test RED on TVSeries, THUMOS-14 and TV-Human-Interaction datasets for action anticipation and achieve state-of-the-art performance on all datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。