Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales, especially larger anomalies such as entire missing components. Addressing this, we present a novel framework that enhances the capability of diffusion models, by extending the previous introduced implicit conditioning approach Meng et al. (2022) in three significant ways. First, we incorporate a dynamic step size computation that allows for variable noising steps in the forward process guided by an initial anomaly prediction. Second, we demonstrate that denoising an only scaled input, without any added noise, outperforms conventional denoising process. Third, we project images in a latent space to abstract away from fine details that interfere with reconstruction of large missing components. Additionally, we propose a fine-tuning mechanism that facilitates the model to effectively grasp the nuances of the target domain. Our method undergoes rigorous evaluation on prominent anomaly detection datasets VisA, BTAD and MVTec yielding strong performance. Importantly, our framework effectively localizes anomalies regardless of their scale, marking a pivotal advancement in diffusion-based anomaly detection.
One-for-More: Continual Diffusion Model for Anomaly Detection
East China Normal University(东华师范大学);Shanghai Innovation Institute(上海创新研究院);Xiamen University(厦门大学);Shanghai Jiao Tong University(上海交通大学);Tencent YouTu Lab(腾讯YouTu实验室);Tencent WeChatPay Lab33(腾讯微信支付实验室);CATL(宁德时代);Key Laboratory of Multimedia Trusted Perception and Efficient Computing Ministry of Education of China(教育部多媒体可信感知与高效计算重点实验室)
本文针对扩散模型在持续异常检测中的保真幻觉与灾难性遗忘问题,提出基于梯度投影的持续扩散模型,并通过迭代奇异值分解降低内存开销,同时引入异常掩码网络增强条件机制,在 MVTec 和 VisA 上取得领先性能。
Double Helix Diffusion for Cross-Domain Anomaly Image Generation
School of Computer Science, Wuhan University(武汉大学计算机学院);Shenzhen Intellifusion Technologies Co Ltd(深圳智融科技有限公司);Guangdong Artificial Intelligence and Digital Economy Laboratory (SZ)(广东省人工智能与数字经济实验室)
In medical applications, weakly supervised anomaly detection methods are of great interest, as only image-level annotations are required for training. Current anomaly detection methods mainly rely on generative adversarial networks or autoencoder models. Those models are often complicated to train or have difficulties to preserve fine details in the image. We present a novel weakly supervised anomaly detection method based on denoising diffusion implicit models. We combine the deterministic iterative noising and denoising scheme with classifier guidance for image-to-image translation between d…
Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomization
Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USA(Athinoula A. Martinos 生物医学成像中心、麻省总医院和哈佛医学院,波士顿,美国);Danish Research Centre for Magnetic Resonance, Department of Radiology and Nuclear Medicine(丹麦磁共振研究中心、放射学与核医学部门);Copenhagen University Hospital– Amager and Hvidovre(哥本哈根大学医院–阿马格和赫维多尔)
Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(教育部新一代人工智能技术及其交叉应用重点实验室(东南大学));State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所多模态人工智能系统国家重点实验室(MAIS));School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Noise-Informed Diffusion-Generated Image Detection with Anomaly Attention
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);New Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所模式识别实验室);Nanjing University of Information Science and Technology(南京信息科学技术大学);State Key Laboratory of Media Convergence and Communication, Communication University of China(中国传媒大学媒体融合与传播国家重点实验室)
Hamburg University of Technology(汉堡工业大学);Jung Diagnostics GmbH(荣格诊断有限公司)
The use of supervised deep learning techniques to detect pathologies in brain MRI scans can be challenging due to the diversity of brain anatomy and the need for annotated data sets. An alternative approach is to use unsupervised anomaly detection, which only requires sample-level labels of healthy brains to create a reference representation. This reference representation can then be compared to unhealthy brain anatomy in a pixel-wise manner to identify abnormalities. To accomplish this, generative models are needed to create anatomically consistent MRI scans of healthy brains. While recent di…
Pathology-Informed Latent Diffusion Model for Anomaly Detection in Lymph Node Metastasis
School of Electrical Engineering, Korea University, Seoul 02841, Korea(韩国大学电子工程学院);Department of Pathology, Korea University Anam Hospital and Department of Biomedical Informatics, Korea University College of Medicine, Seoul 02841, Korea(韩国大学医学院病理学系);Department of Hospital Pathology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Korea(韩国天主大学医学院圣玛丽医院医院病理学系)
Denoising Diffusion Models for Anomaly Localization in Medical Images
School of Computation, Information and Technology, Technical University of Munich(慕尼黑技术大学计算、信息与技术学院);Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich, Germany(生物医学影像机器学习研究所,海德堡慕尼黑德国);Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland(巴塞尔大学生物医学工程系,瑞士Allschwil);School of Biomedical Engineering and Imaging Sciences, King’s College London, United Kingdom(伦敦国王学院生物医学工程与影像科学学院,英国);Department of Biomedical Informatics and Data Science, Yale University School of Medicine, New Haven, CT, USA(耶鲁大学医学院生物医学信息学与数据科学系,美国新罕布什尔州新 Haven);Yale Biomedical Imaging Institute, Yale University, New Haven, CT, USA(耶鲁大学生物医学影像研究院,美国新罕布什尔州新 Haven)
Single-Step Reconstruction-Free Anomaly Detection and Segmentation via Diffusion Models
H. Milton Stewart School of Industrial and Systems Engineering(H. Milton Stewart工业与系统工程学院);Georgia Institute of Technology(佐治亚理工学院);Department of Mechanical Engineering(机械工程系);Polytechnic University of Milan(米兰理工学院)
Tau Anomaly Detection in PET Imaging via Bilateral-Guided Deterministic Diffusion Model
Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California(斯蒂文斯神经影像与信息学研究所,凯克医学院,南加州大学);Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California(明希部门电气与计算机工程系,维特比工程学院,南加州大学);Alfred E. Mann Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California(阿尔弗雷德·E·曼生物医学工程系,维特比工程学院,南加州大学)
Pancreatic Tumor Segmentation as Anomaly Detection in CT Images Using Denoising Diffusion Models
School of Electrical and Computer Engineering, University of Oklahoma(俄克拉荷马大学电气与计算机工程学院);University of Oklahoma Health Sciences Center(俄克拉荷马大学健康科学中心);School of Computer Science, University of Oklahoma(俄克拉荷马大学计算机科学学院)
Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images
University of Edinburgh(爱丁堡大学);NHS Lothian(洛锡安国民保健服务体系);UK Dementia Research Institute Centre, University of Edinburgh(英国痴呆症研究所爱丁堡中心);University of Dundee(邓迪大学)
King’s College London(伦敦国王学院);University College London(伦敦大学学院);Birkbeck College(伯克贝克学院);King’s College Hospital NHS Foundation Trust(国王学院医院国民保健服务基金会信托);St George’s University Hospitals NHS Foundation Trust(圣乔治大学医院国民保健服务基金会信托);Atkinson Morley Regional Neuroscience Centre(阿特金森·莫利地区神经科学中心);UCL Queen Square Institute of Neurology(伦敦大学学院皇后广场神经病学研究所)
Deep generative models have emerged as promising tools for detecting arbitrary anomalies in data, dispensing with the necessity for manual labelling. Recently, autoregressive transformers have achieved state-of-the-art performance for anomaly detection in medical imaging. Nonetheless, these models still have some intrinsic weaknesses, such as requiring images to be modelled as 1D sequences, the accumulation of errors during the sampling process, and the significant inference times associated with transformers. Denoising diffusion probabilistic models are a class of non-autoregressive generativ…
Key Laboratory of Multimedia Trusted Perception and Efficient Computing(多媒体可信感知与高效计算重点实验室);Ministry of Education of China(中华人民共和国教育部);Xiamen University(厦门大学);VIVO