Zero-Shot image Anomaly Detection (ZSAD) aims to detect and localise anomalies without access to any normal training samples of the target data. While recent ZSAD approaches leverage additional modalities such as language to generate fine-grained prompts for localisation, vision-only methods remain limited to image-level classification, lacking spatial precision. In this work, we introduce a simple yet effective training-free vision-only ZSAD framework that circumvents the need for fine-grained prompts by leveraging the inversion of a pretrained Denoising Diffusion Implicit Model (DDIM). Specifically, given an input image and a generic text description (e.g., "an image of an [object class]"), we invert the image to obtain latent representations and initiate the denoising process from a fixed intermediate timestep to reconstruct the image. Since the underlying diffusion model is trained solely on normal data, this process yields a normal-looking reconstruction. The discrepancy between the input image and the reconstructed one highlights potential anomalies. Our method achieves state-of-the-art performance on VISA dataset, demonstrating strong localisation capabilities without auxiliary modalities and facilitating a shift away from prompt dependence for zero-shot anomaly detection research. Code is available at https://github.com/giddyyupp/DIVAD.
CLIP-FSAC++: Few-Shot Anomaly Classification with Anomaly Descriptor Based on CLIP
Xi’an Jiaotong University(西安交通大学);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳));Xiamen University(厦门大学);Shenzhen University(深圳大学)
APRIL-GAN: A Zero-/Few-Shot Anomaly Classification and Segmentation Method for CVPR 2023 VAND Workshop Challenge Tracks 1&2: 1st Place on Zero-shot AD and 4th Place on Few-shot AD
Key Laboratory of Multimedia Trusted Perception and Efficient Computing(多媒体可信感知与高效计算重点实验室);Ministry of Education of China(中华人民共和国教育部);Xiamen University(厦门大学);VIVO
Nerf-based Generative models have shown impressive capacity in generating high-quality images with consistent 3D geometry. Despite successful synthesis of fake identity images randomly sampled from latent space, adopting these models for generating face images of real subjects is still a challenging task due to its so-called inversion issue. In this paper, we propose a universal method to surgically fine-tune these NeRF-GAN models in order to achieve high-fidelity animation of real subjects only by a single image. Given the optimized latent code for an out-of-domain real image, we employ 2D lo…
Georgia Institute of Technology(佐治亚理工学院);Apple(苹果公司)
Generative adversarial networks (GANs), trained on a large-scale image dataset, can be a good approximator of the natural image manifold. GAN-inversion, using a pre-trained generator as a deep generative prior, is a promising tool for image restoration under corruptions. However, the performance of GAN-inversion can be limited by a lack of robustness to unknown gross corruptions, i.e., the restored image might easily deviate from the ground truth. In this paper, we propose a Robust GAN-inversion (RGI) method with a provable robustness guarantee to achieve image restoration under unknown \texti…
MAGIC: Few-Shot Mask-Guided Anomaly Inpainting with Prompt Perturbation, Spatially Adaptive Guidance, and Context Awareness
Department of AI Semiconductor Engineering, Hanyang University, Seoul, Korea(汉阳大学人工智能半导体工程系);Department of Electronic Engineering, Hanyang University, Seoul, Korea(汉阳大学电子工程系)
Visual Prompting for One-shot Controllable Video Editing without Inversion
Singapore University of Technology and Design(新加坡科技设计大学);Wuhan University(武汉大学);Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore(新加坡资讯与通信研究院)
Corning Inc.(康宁公司);University of Rochester(罗切斯特大学)
Video anomaly detection aims to identify abnormal events that occurred in videos. Since anomalous events are relatively rare, it is not feasible to collect a balanced dataset and train a binary classifier to solve the task. Thus, most previous approaches learn only from normal videos using unsupervised or semi-supervised methods. Obviously, they are limited in capturing and utilizing discriminative abnormal characteristics, which leads to compromised anomaly detection performance. In this paper, to address this issue, we propose a new learning paradigm by making full use of both normal and abn…
PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detection
East China Normal University(华东师范大学);Chongqing Institute of East China Normal University(华东师范大学重庆研究院);The Navy Military Medical University(海军军医大学);Xiamen University(厦门大学)
AF-CLIP: Zero-Shot Anomaly Detection via Anomaly-Focused CLIP Adaptation
School of Computer Science and Engineering(计算机科学与工程学院);Sun Yat-sen University(中山大学);Guangdong Key Laboratory of Big Data Analysis and Processing(大数据分析与处理广东省重点实验室)
SD-MAD: Sign-Driven Few-shot Multi-Anomaly Detection in Medical Images
Shanghai Academy of AI for Science University of Queensland(上海人工智能科学研究院 华南理工大学);Fudan University Shanghai Academy of AI for Science(复旦大学 上海人工智能科学研究院);University of Queensland(昆士兰大学)
COFT-AD: COntrastive Fine-Tuning for Few-Shot Anomaly Detection
Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局信息通信研究院);Centre for Frontier AI Research (CFAR), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局前沿人工智能研究中心)
MediCLIP: Adapting CLIP for Few-shot Medical Image Anomaly Detection
College of Information and Engineering, Capital Normal University(首都师范大学信息工程学院);Peking University Third Hospital(北京大学第三医院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
One-to-Normal: Anomaly Personalization for Few-shot Anomaly Detection
West China Hospital, Sichuan University(四川大学华西医院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);Sichuan University Pittsburgh Institute, Sichuan University(四川大学匹兹堡学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
PSMP-CLIP: Patch-Prompt SAM and Multi-Semantic Prompting for CLIP-Based Zero-Shot Anomaly Detection
Harbin Engineering University(哈尔滨工程大学);Key Laboratory of Advanced Marine Communication and Information Technology(先进海洋通信与信息技术重点实验室);University of Toronto(多伦多大学);Kanagawa University(神奈川大学)
DeltaDeno: Zero-Shot Anomaly Generation via Delta-Denoising Attribution
Institute of Automation, Chinese Academy of Sciences, Beijing, China(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学人工智能学院);CASI Vision Technology CO., LTD., Luoyang, China(CASI视觉科技有限公司);School of Artificial Intelligence and Robotics, Hunan University, Changsha, China(湖南大学人工智能与机器人学院)
CLIP3D-AD: Extending CLIP for 3D Few-Shot Anomaly Detection with Multi-View Images Generation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人机混合增强智能全国重点实验室与人工智能与机器人研究所);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳));Xiamen University(厦门大学);Shenzhen University(深圳大学)