arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.01769cs.CVcs.DB
收藏

VideoScoop:一种非传统、领域无关的视频分析框架

VideoScoop: A Non-Traditional Domain-Independent Framework For Video Analysis

Hafsa Billah

AI总结:

VideoScoop提出一种通用视频情境分析框架,通过扩展关系模型和图模型实现领域无关的视频内容分析,提升情境检测的准确性和效率。

摘要:

自动理解视频内容对于公民监控(CM)、一般监控(SL)、辅助生活(AL)等应用至关重要。数十年的图像和视频分析(IVA)研究已推动了内容提取(例如,对象识别和跟踪)等任务的发展。然而,识别有意义的活动或情境(例如,两个物体靠近)仍然困难重重,无法仅通过内容提取实现。目前,视频情境分析(VSA)通常由人工在环中完成,这容易出错且劳动密集,或通过为特定视频类型或情境定制的算法完成。这些算法不是通用的,需要为每个新情境或新领域视频开发新的算法/软件。本报告提出了一种通用的VSA框架,克服了上述限制。使用最先进的视频内容提取技术一次性提取视频内容。它们通过两种替代模型进行表示——扩展关系模型(R++)和图模型。当使用R++表示时,提取的内容可以作为数据流,通过所提出的视频分析连续查询语言进行连续查询处理。图模型通过使检测到的情境成为可能,补充了这一点,这些情境难以或不可能仅通过关系模型单独检测。现有的图算法和新开发的算法支持广泛的情境检测。为了支持领域无关性,跨领域的原始情境变体被识别并表示为参数化模板。在三个领域——AL、CM和SL——的多个有趣情境上进行了广泛的实验,使用来自这些领域的不同长度视频数据集来评估所提出方法的准确性、效率和鲁棒性。

英文摘要:

Automatically understanding video contents is important for several applications in Civic Monitoring (CM), general Surveillance (SL), Assisted Living (AL), etc. Decades of Image and Video Analysis (IVA) research have advanced tasks such as content extraction (e.g., object recognition and tracking). Identifying meaningful activities or situations (e.g., two objects coming closer) remains difficult and cannot be achieved by content extraction alone. Currently, Video Situation Analysis (VSA) is done manually with a human in the loop, which is error-prone and labor-intensive, or through custom algorithms designed for specific video types or situations. These algorithms are not general-purpose and require a new algorithm/software for each new situation or video from a new domain. This report proposes a general-purpose VSA framework that overcomes the above limitations. Video contents are extracted once using state-of-the-art Video Content Extraction technologies. They are represented using two alternative models -- the extended relational model (R++) and graph models. When represented using R++, the extracted contents can be used as data streams, enabling Continuous Query Processing via the proposed Continuous Query Language for Video Analysis. The graph models complement this by enabling the detection of situations that are difficult or impossible to detect using the relational model alone. Existing graph algorithms and newly developed algorithms support a wide variety of situation detection. To support domain independence, primitive situation variants across domains are identified and expressed as parameterized templates. Extensive experiments were conducted across several interesting situations from three domains -- AL, CM, and SL-- to evaluate the accuracy, efficiency, and robustness of the proposed approach using a dataset of videos of varying lengths from these domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑