arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.11368cs.LG
收藏

无监督异常检测的巧合学习

Coincident Learning for Unsupervised Anomaly Detection

Stanford University(斯坦福大学);SLAC National Laboratory(SLAC国家实验室)

Ryan Humble, Zhe Zhang, Finn O'Shea, Eric Darve, Daniel Ratner

AI总结:

本文提出CoAD方法,利用特征空间不同切片间的巧合行为,通过无监督指标$\hat{F}_β$训练异常检测算法,适用于多模态任务,并在合成、MNIST及两个真实数据集上验证了有效性。

摘要:

异常检测对于复杂系统(如工业设施、制造业、大规模科学实验)是一项重要任务,其中子系统的故障可能导致低产量、有缺陷的产品,甚至损坏部件。虽然复杂系统通常拥有丰富的数据,但标记的异常通常很少(甚至不存在)且获取成本高昂。因此,无监督方法很常见,通常通过在输入特征空间(或相关的低维表示)中示例的距离或密度来搜索异常。本文提出了一种名为CoAD的新方法,专门为多模态任务设计,并基于特征空间两个不同切片上的“巧合”行为来识别异常。我们定义了一个无监督指标,$\hat{F}_β$,类比于监督分类的$F_β$统计量。CoAD使用$\hat{F}_β$在未标记数据上训练异常检测算法,基于一个特征切片中的异常行为与另一个切片中的异常行为巧合的期望。该方法通过合成异常数据集和基于MNIST的图像数据集进行说明,并在两个真实世界任务上与先前的最先进方法进行了比较:金属铣削数据集和粒子加速器的数据集。

英文摘要:

Anomaly detection is an important task for complex systems (e.g., industrial facilities, manufacturing, large-scale science experiments), where failures in a sub-system can lead to low yield, faulty products, or even damage to components. While complex systems often have a wealth of data, labeled anomalies are typically rare (or even nonexistent) and expensive to acquire. Unsupervised approaches are therefore common and typically search for anomalies either by distance or density of examples in the input feature space (or some associated low-dimensional representation). This paper presents a novel approach called CoAD, which is specifically designed for multi-modal tasks and identifies anomalies based on \textit{coincident} behavior across two different slices of the feature space. We define an \textit{unsupervised} metric, $\hat{F}_β$, out of analogy to the supervised classification $F_β$ statistic. CoAD uses $\hat{F}_β$ to train an anomaly detection algorithm on \textit{unlabeled data}, based on the expectation that anomalous behavior in one feature slice is coincident with anomalous behavior in the other. The method is illustrated using a synthetic outlier data set and a MNIST-based image data set, and is compared to prior state-of-the-art on two real-world tasks: a metal milling data set and a data set from a particle accelerator.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑