用于动态视频缩略图生成的句子引导时间调制
Sentence Guided Temporal Modulation for Dynamic Video Thumbnail Generation
摘要：
我们考虑的问题，句子指定的动态视频缩略图生成。给定输入视频和用户查询语句，目标是生成不仅提供视频内容的预览，而且在语义上对应于语句的视频缩略图。在本文中，我们提出了一个句子引导的时间调制（SGTM）机制，利用句子嵌入调制的归一化的时间激活的视频缩略图生成网络。与现有的国家的最先进的方法，使用经常性的架构，我们提出了一个非经常性的框架，是简单的，并允许更多的并行化。在大规模数据集上的大量实验和分析证明了该框架的有效性。
英文摘要：
We consider the problem of sentence specified dynamic video thumbnail generation. Given an input video and a user query sentence, the goal is to generate a video thumbnail that not only provides the preview of the video content, but also semantically corresponds to the sentence. In this paper, we propose a sentence guided temporal modulation (SGTM) mechanism that utilizes the sentence embedding to modulate the normalized temporal activations of the video thumbnail generation network. Unlike the existing state-of-the-art method that uses recurrent architectures, we propose a non-recurrent framework that is simple and allows much more parallelization. Extensive experiments and analysis on a large-scale dataset demonstrate the effectiveness of our framework.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
