arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.00464cs.LGcs.AI
收藏

基于自监督学习的自适应记忆网络的无监督异常检测

Adaptive Memory Networks with Self-supervised Learning for Unsupervised Anomaly Detection

Global Energy Interconnection Development and Cooperation Organization(全球能源互联网发展合作组织);Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所移动计算与新型终端北京市重点实验室);University of Chinese Academy of Sciences(中国科学院大学);Peng Cheng Laboratory(鹏城实验室);Microsoft Research(微软研究院);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院)

Yuxin Zhang, Jindong Wang, Yiqiang Chen, Han Yu, Tao Qin

摘要:

无监督异常检测旨在通过仅对正常数据进行训练来构建模型以有效地检测不可见的异常。虽然以前的基于重建的方法已经取得了丰硕的进展,他们的推广能力是有限的,由于两个关键的挑战。首先,训练数据集只包含正常模式,这限制了模型的泛化能力。其次,现有模型学习的特征表示往往缺乏代表性,这阻碍了保持正常模式多样性的能力。在本文中,我们提出了一种新的方法称为自适应记忆网络与自监督学习(AMSL),以解决这些挑战,并提高泛化能力,在无监督的异常检测。基于卷积自动编码器结构,AMSL结合了一个自监督学习模块来学习一般的正常模式和一个自适应记忆融合模块来学习丰富的特征表示。在四个公开的多变量时间序列数据集上的实验表明,AMSL显著提高了性能相比,其他国家的最先进的方法。具体而言,在具有9亿个样本的最大CAP睡眠阶段检测数据集上,AMSL在准确性和F1评分方面均优于第二好基线\textbf{4} \%+。除了增强的泛化能力,AMSL对输入噪声也更鲁棒。

英文摘要:

Unsupervised anomaly detection aims to build models to effectively detect unseen anomalies by only training on the normal data. Although previous reconstruction-based methods have made fruitful progress, their generalization ability is limited due to two critical challenges. First, the training dataset only contains normal patterns, which limits the model generalization ability. Second, the feature representations learned by existing models often lack representativeness which hampers the ability to preserve the diversity of normal patterns. In this paper, we propose a novel approach called Adaptive Memory Network with Self-supervised Learning (AMSL) to address these challenges and enhance the generalization ability in unsupervised anomaly detection. Based on the convolutional autoencoder structure, AMSL incorporates a self-supervised learning module to learn general normal patterns and an adaptive memory fusion module to learn rich feature representations. Experiments on four public multivariate time series datasets demonstrate that AMSL significantly improves the performance compared to other state-of-the-art methods. Specifically, on the largest CAP sleep stage detection dataset with 900 million samples, AMSL outperforms the second-best baseline by \textbf{4}\%+ in both accuracy and F1 score. Apart from the enhanced generalization ability, AMSL is also more robust against input noise.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑