One pivot challenge for image anomaly (AD) detection is to learn discriminative information only from normal class training images. Most image reconstruction based AD methods rely on the discriminative capability of reconstruction error. This is heuristic as image reconstruction is unsupervised without incorporating normal-class-specific information. In this paper, we propose an AD method called dual deep reconstruction networks based image decomposition (DDR-ID). The networks are trained by jointly optimizing for three losses: the one-class loss, the latent space constrain loss and the reconstruction loss. After training, DDR-ID can decompose an unseen image into its normal class and the residual components, respectively. Two anomaly scores are calculated to quantify the anomalous degree of the image in either normal class latent space or reconstruction image space. Thereby, anomaly detection can be performed via thresholding the anomaly score. The experiments demonstrate that DDR-ID outperforms multiple related benchmarking methods in image anomaly detection using MNIST, CIFAR-10 and Endosome datasets and adversarial attack detection using GTSRB dataset.
Value-order Decomposition for Generalist Anomaly Detection
Dalian University of Technology(大连理工大学);Xi’an Chang’an Vanke City Primary School(西安长安万科城小学);Key Laboratory of Social Computing and Cognitive Intelligence (Dalian University of Technology), Ministry of Education(社会计算与认知智能教育部重点实验室(大连理工大学))
Variational Auto-Encoders have often been used for unsupervised pretraining, feature extraction and out-of-distribution and anomaly detection in the medical field. However, VAEs often lack the ability to produce sharp images and learn high-level features. We propose to alleviate these issues by adding a new branch to conditional hierarchical VAEs. This enforces a division between higher-level and lower-level features. Despite the additional computational overhead compared to a normal VAE it results in sharper and better reconstructions and can capture the data distribution similarly well (indi…
Anomaly detection (AD) has been an active research area in various domains. Yet, the increasing data scale, complexity, and dimension turn the traditional methods into challenging. Recently, the deep generative model, such as the variational autoencoder (VAE), has sparked a renewed interest in the AD problem. However, the probability distribution divergence used as the regularization is too strong, which causes the model cannot capture the manifold of the true data. In this paper, we propose the Projected Sliced Wasserstein (PSW) autoencoder-based anomaly detection method. Rooted in the optima…
Hyperspectral Anomaly Detection Fused Unified Nonconvex Tensor Ring Factors Regularization
School of Mathematics and Statistics, Southwest University(数学与统计学学院,西南大学);School of Mathematics and Statistics, Xi’an Jiaotong University(数学与统计学学院,西安交通大学);School of Computer Science and Technology and Ministry of Education Key Lab For Intelligent Networks and Network Security, Xi’an Jiaotong University(计算机科学与技术学院和教育部智能网络与网络安全重点实验室,西安交通大学);School of Mathematical Sciences/Research Center for Image and Vision Computing, University of Electronic Science and Technology of China(数学科学学院/图像与视觉计算研究中心,电子科技大学);Institute of Methodologies for Environmental Analysis, CNR-IMAA(环境分析方法学研究所,CNR-IMAA)
A Novel Representation of Periodic Pattern and Its Application to Untrained Anomaly Detection
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Guangzhou HKUST Fok Ying Tung Research Institute(广州香港科技大学霍英东研究院)
Nanjing University of Science and Technology(南京理工大学);The University of Adelaide(阿德莱德大学)
RGB images differentiate from depth images as they carry more details about the color and texture information, which can be utilized as a vital complementary to depth for boosting the performance of 3D semantic scene completion (SSC). SSC is composed of 3D shape completion (SC) and semantic scene labeling while most of the existing methods use depth as the sole input which causes the performance bottleneck. Moreover, the state-of-the-art methods employ 3D CNNs which have cumbersome networks and tremendous parameters. We introduce a light-weight Dimensional Decomposition Residual network (DDR) …
University of Science and Technology of China(中国科学技术大学)
Ground Penetrating Radar (GPR) has been widely used to estimate the healthy operation of some urban roads and underground facilities. When identifying subsurface anomalies by GPR in an area, the obtained data could be unbalanced, and the numbers and types of possible underground anomalies could not be acknowledged in advance. In this paper, a novel method is proposed to improve the subsurface anomaly detection from GPR B-scan images. A normal (i.e. without subsurface objects) GPR image section is firstly collected in the detected area. Concerning that the GPR image is essentially the represent…
University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Kitware Inc.(Kitware公司)
Advection-diffusion equations describe a large family of natural transport processes, e.g., fluid flow, heat transfer, and wind transport. They are also used for optical flow and perfusion imaging computations. We develop a machine learning model, D^2-SONATA, built upon a stochastic advection-diffusion equation, which predicts the velocity and diffusion fields that drive 2D/3D image time-series of transport. In particular, our proposed model incorporates a model of transport atypicality, which isolates abnormal differences between expected normal transport behavior and the observed transport. …
Key Laboratory of Multimedia Trusted Perception and Efficient Computing(多媒体可信感知与高效计算重点实验室);Ministry of Education of China(中华人民共和国教育部);Xiamen University(厦门大学);VIVO
Georgia Institute of Technology(佐治亚理工学院);Apple(苹果公司)
Unsupervised pixel-level defective region segmentation is an important task in image-based anomaly detection for various industrial applications. The state-of-the-art methods have their own advantages and limitations: matrix-decomposition-based methods are robust to noise but lack complex background image modeling capability; representation-based methods are good at defective region localization but lack accuracy in defective region shape contour extraction; reconstruction-based methods detected defective region match well with the ground truth defective region shape contour but are noisy. To …
One-for-More: Continual Diffusion Model for Anomaly Detection
East China Normal University(东华师范大学);Shanghai Innovation Institute(上海创新研究院);Xiamen University(厦门大学);Shanghai Jiao Tong University(上海交通大学);Tencent YouTu Lab(腾讯YouTu实验室);Tencent WeChatPay Lab33(腾讯微信支付实验室);CATL(宁德时代);Key Laboratory of Multimedia Trusted Perception and Efficient Computing Ministry of Education of China(教育部多媒体可信感知与高效计算重点实验室)
本文针对扩散模型在持续异常检测中的保真幻觉与灾难性遗忘问题,提出基于梯度投影的持续扩散模型,并通过迭代奇异值分解降低内存开销,同时引入异常掩码网络增强条件机制,在 MVTec 和 VisA 上取得领先性能。