arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.00580cs.CVcs.AI
收藏

TRACES:用于实时视频异常检测的基于上下文嵌入的时间召回

TRACES: Temporal Recall with Contextual Embeddings for Real-Time Video Anomaly Detection

Department of Computer Science(计算机科学系);System Research Laboratory (SysLab)(系统研究实验室)

Yousuf Ahmed Siddiqui, Sufiyaan Usmani, Umer Tariq, Jawwad Ahmed Shamsi, Muhammad Burhan Khan

AI总结:

本文提出记忆增强的零样本视频异常检测框架TRACES,通过交叉注意力融合时间信号与视觉嵌入并进行上下文相似度评分,在UCF-Crime和XD-Violence数据集上达到SOTA,实现了高精度、可解释的实时推理。

摘要:

视频异常通常依赖于可用的上下文信息和时间演变。在一种上下文中非异常的动作,在另一种上下文中可能是异常的。然而,大多数异常检测器并未注意到此类上下文,这严重限制了它们泛化到新现实生活场景的能力。我们的工作解决了上下文感知的零样本异常检测挑战,在该挑战中,系统需要自适应地学习,通过将时间和外观特征与记忆的文本痕迹进行实时关联来检测新事件。我们的方法定义了一个记忆增强流水线,使用交叉注意力将时间信号与视觉嵌入相关联,并通过上下文相似度评分进行实时零样本异常分类。我们在 UCF-Crime 上实现了 90.4% 的 AUC,在 XD-Violence 上实现了 83.67% 的 AP,在零样本模型中达到了新的最优水平。我们的模型实现了实时推理,具有高精度和可解释性,便于部署。我们表明,通过融合交叉注意力时间融合和上下文记忆,我们实现了高保真异常检测,向零样本模型在现实世界监控和基础设施监控中的适用性迈进了一步。

英文摘要:

Video anomalies often depend on contextual information available and temporal evolution. Non-anomalous action in one context can be anomalous in some other context. Most anomaly detectors, however, do not notice this type of context, which seriously limits their capability to generalize to new, real-life situations. Our work addresses the context-aware zero-shot anomaly detection challenge, in which systems need to learn adaptively to detect new events by correlating temporal and appearance features with textual traces of memory in real time. Our approach defines a memory-augmented pipeline, correlating temporal signals with visual embeddings using cross-attention, and real-time zero-shot anomaly classification by contextual similarity scoring. We achieve 90.4\% AUC on UCF-Crime and 83.67\% AP on XD-Violence, a new state-of-the-art among zero-shot models. Our model achieves real-time inference with high precision and explainability for deployment. We show that, by fusing cross-attention temporal fusion and contextual memory, we achieve high fidelity anomaly detection, a step towards the applicability of zero-shot models in real-world surveillance and infrastructure monitoring.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑