arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.08022cs.CV

无需训练的零样本视觉异常定位 via 扩散倒置

Training Free Zero-Shot Visual Anomaly Localization via Diffusion Inversion

University of Luxembourg(卢森堡大学)

Samet Hicsonmez, Abd El Rahman Shabayek, Djamila Aouada

AI总结:

本文提出无需训练的视觉-only零样本异常检测框架,通过扩散倒置技术实现高精度异常定位,无需细粒度提示,提升零样本检测性能。

摘要:

零样本图像异常检测(ZSAD)旨在在没有目标数据任何正常训练样本的情况下检测和定位异常。尽管最近的ZSAD方法利用了其他模态,如语言,来生成细粒度的提示以进行定位,仅基于视觉的方法仍然局限于图像级分类,缺乏空间精度。在本工作中,我们引入了一个简单而有效的无需训练的视觉-only ZSAD框架,通过利用预训练的去噪扩散隐式模型(DDIM)的倒置来避免对细粒度提示的依赖。具体来说,给定一个输入图像和一个通用文本描述(例如,“一个[对象类别]的图像”),我们通过倒置图像来获得潜在表示,并从固定中间时间步开始启动去噪过程以重建图像。由于底层扩散模型仅在正常数据上进行训练,此过程会产生一个看起来正常的重建。输入图像与重建图像之间的差异突显出潜在的异常。我们的方法在VISA数据集上实现了最先进的性能,证明了在没有辅助模态的情况下强大的定位能力,并促进了零样本异常检测研究向提示依赖性转变。代码可在https://github.com/giddyyupp/DIVAD上获取。

英文摘要:

Zero-Shot image Anomaly Detection (ZSAD) aims to detect and localise anomalies without access to any normal training samples of the target data. While recent ZSAD approaches leverage additional modalities such as language to generate fine-grained prompts for localisation, vision-only methods remain limited to image-level classification, lacking spatial precision. In this work, we introduce a simple yet effective training-free vision-only ZSAD framework that circumvents the need for fine-grained prompts by leveraging the inversion of a pretrained Denoising Diffusion Implicit Model (DDIM). Specifically, given an input image and a generic text description (e.g., "an image of an [object class]"), we invert the image to obtain latent representations and initiate the denoising process from a fixed intermediate timestep to reconstruct the image. Since the underlying diffusion model is trained solely on normal data, this process yields a normal-looking reconstruction. The discrepancy between the input image and the reconstructed one highlights potential anomalies. Our method achieves state-of-the-art performance on VISA dataset, demonstrating strong localisation capabilities without auxiliary modalities and facilitating a shift away from prompt dependence for zero-shot anomaly detection research. Code is available at https://github.com/giddyyupp/DIVAD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑