基于语义记忆的视频流隐形检索
Video Stream Retrieval of Unseen Queries using Semantic Memory
摘要:
实时用户广播视频流的检索是一个未得到充分解决且日益相关的挑战。在线性质的问题需要时间评估和不可预见的范围内潜在的查询动机的方法,可以容纳任意的搜索查询。考虑到可能的查询的广度,我们采用了一种无示例的方法来进行查询检索,该方法使用查询的语义相关性来预先训练概念分类器。为了适应不断变化的视频内容,我们提出了内存池和内存溢出的方法,有利于最近的信息在很久以前的内容。我们确定了两个流检索任务,在任何特定的时间和连续检索在一个较长的时间内的瞬时检索,并提出了评估它们的方法。三个大规模的视频数据集是适应流检索的挑战。我们报告的结果,我们的搜索方法对新的流检索任务,以及证明其在传统的,非流视频任务的功效。
英文摘要:
Retrieval of live, user-broadcast video streams is an under-addressed and increasingly relevant challenge. The on-line nature of the problem requires temporal evaluation and the unforeseeable scope of potential queries motivates an approach which can accommodate arbitrary search queries. To account for the breadth of possible queries, we adopt a no-example approach to query retrieval, which uses a query's semantic relatedness to pre-trained concept classifiers. To adapt to shifting video content, we propose memory pooling and memory welling methods that favor recent information over long past content. We identify two stream retrieval tasks, instantaneous retrieval at any particular time and continuous retrieval over a prolonged duration, and propose means for evaluating them. Three large scale video datasets are adapted to the challenge of stream retrieval. We report results for our search methods on the new stream retrieval tasks, as well as demonstrate their efficacy in a traditional, non-streaming video task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。