ExSample：通过自适应采样对视频库进行有效的检索
ExSample: Efficient Searches on Video Repositories through Adaptive Sampling
摘要：
随着摄像机的部署成本越来越低，捕获和处理视频变得越来越普遍。与此同时，丰富的视频理解方法在过去十年中取得了很大进展。因此，许多组织现在拥有大量视频数据存储库，并在地图，导航，自动驾驶和其他领域应用。由于最先进的目标检测方法速度慢且成本高，因此我们在积累的数据上处理甚至简单的特定目标搜索查询（“在仪表盘视频中查找100个交通灯”）的能力远远落后于我们收集这些数据的能力。对于这些类型的查询，以降低的采样率处理视频是合理的默认策略，但是，理想的采样率取决于数据和查询。我们引入ExSample，一个低成本的框架，用于在未索引的视频上进行对象搜索，通过将采样帧的数量和位置适应于正在处理的特定数据和查询来快速处理搜索查询。ExSample在视频存储库中优先处理帧，以便处理集中在最有可能包含感兴趣对象的视频部分。它会根据先前处理过的帧的反馈，不断重新确定处理的优先级。在大型的真实数据集上，ExSample与高效的随机采样基线相比，可将处理时间减少多达6倍，与训练专门的按查询代理模型的最新方法相比，可将处理时间减少几个数量级。因此，ExSample是构建经济高效的视频数据管理系统的关键组件。
英文摘要：
Capturing and processing video is increasingly common as cameras become cheaper to deploy. At the same time, rich video understanding methods have progressed greatly in the last decade. As a result, many organizations now have massive repositories of video data, with applications in mapping, navigation, autonomous driving, and other areas. Because state-of-the-art object detection methods are slow and expensive, our ability to process even simple ad-hoc object search queries ('find 100 traffic lights in dashcam video') over this accumulated data lags far behind our ability to collect it. Processing video at reduced sampling rates is a reasonable default strategy for these types of queries, however, the ideal sampling rate is both data and query dependent. We introduce ExSample, a low cost framework for object search over unindexed video that quickly processes search queries by adapting the amount and location of sampled frames to the particular data and query being processed. ExSample prioritizes the processing of frames in a video repository so that processing is focused in portions of video that most likely contain objects of interest. It continually re-prioritizes processing based on feedback from previously processed frames. On large, real-world datasets, ExSample reduces processing time by up to 6x over an efficient random sampling baseline and by several orders of magnitude over state-of-the-art methods that train specialized per-query surrogate models. ExSample is thus a key component in building cost-efficient video data management systems.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
