arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.04151cs.CV
收藏

一种基于外观-运动语义表示一致性的视频异常检测框架

A Video Anomaly Detection Framework based on Appearance-Motion Semantics Representation Consistency

Xiamen University(厦门大学);Inria Paris-Rocquencourt(法国国家信息与自动化研究所巴黎-罗克库尔分部);Tibet University(西藏大学);Wright State University(莱特州立大学)

Xiangyu Huang, Caidan Zhao, Yilin Wang, Zhiqiang Wu

摘要:

视频异常检测是指对偏离预期行为的事件进行识别。由于训练中缺乏异常样本,视频异常检测成为一项极具挑战性的任务。现有的方法几乎都遵循重建或未来帧预测模式。但是,这些方法忽略了样本的外观和运动信息之间的一致性,限制了其异常检测性能。异常只发生在监控视频的运动前景中,因此,在不考虑背景信息的情况下,异常检测中的视频帧序列和光流所表达的语义应该具有高度的一致性,对异常检测具有重要意义。基于这一思想,本文提出了一种基于正常数据外观和运动语义表示一致性的异常检测框架--外观-运动语义表示一致性(Appearance-Motion Semantics Representation Consistency,AMSRC).首先,设计了一个双流编码器对正常样本的外观和运动信息表示进行编码,并引入约束条件进一步增强正常样本的外观和运动信息之间的特征语义一致性,从而识别出外观和运动特征表示一致性较低的异常样本。此外,异常样本的外观和运动特征的较低一致性可用于生成具有较大重建误差的预测帧,这使得异常更容易被发现。通过仿真和实测数据处理验证了所提方法的有效性。

英文摘要:

Video anomaly detection refers to the identification of events that deviate from the expected behavior. Due to the lack of anomalous samples in training, video anomaly detection becomes a very challenging task. Existing methods almost follow a reconstruction or future frame prediction mode. However, these methods ignore the consistency between appearance and motion information of samples, which limits their anomaly detection performance. Anomalies only occur in the moving foreground of surveillance videos, so the semantics expressed by video frame sequences and optical flow without background information in anomaly detection should be highly consistent and significant for anomaly detection. Based on this idea, we propose Appearance-Motion Semantics Representation Consistency (AMSRC), a framework that uses normal data's appearance and motion semantic representation consistency to handle anomaly detection. Firstly, we design a two-stream encoder to encode the appearance and motion information representations of normal samples and introduce constraints to further enhance the consistency of the feature semantics between appearance and motion information of normal samples so that abnormal samples with low consistency appearance and motion feature representation can be identified. Moreover, the lower consistency of appearance and motion features of anomalous samples can be used to generate predicted frames with larger reconstruction error, which makes anomalies easier to spot. Experimental results demonstrate the effectiveness of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑