arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2512.13671cs.CV

AgentIAD: 通过自适应记忆增强的代理工业异常检测

AgentIAD: Agentic Industrial Anomaly Detection via Adaptive Memory Augmentation

AIR, Tsinghua University(清华大学AIR);Etude AI;Stony Brook University(石溪大学)

Junwen Miao, Penghui Du, Yingying Fan, Yi Liu, Yu Wang, Runze He, Lida Huang, Yan Wang

AI总结:

本文提出AgentIAD框架,通过统一的动作空间实现迭代工业检测,利用视觉记忆和检索记忆进行多轮感知-行动推理,提升异常检测准确性和可解释性。

摘要:

工业异常检测(IAD)因缺陷的细微和高度局部化而具有挑战性,单次通过视觉-语言模型(VLMs)常难以捕捉。此外,现有方法缺乏在推理过程中主动获取互补证据的机制。我们提出AgentIAD,一种代理视觉-语言框架,通过统一的动作空间实现迭代工业检查。代理在检查过程中动态访问两种形式的记忆:通过Perceptive Zoomer(PZ)进行视觉记忆以实现细粒度局部分析,以及通过Web Searcher(WS)和Comparative Retriever(CR)进行外部知识获取和跨实例验证。此设计使模型能够通过多轮感知-行动推理逐步收集证据。为了在稀疏监督下有效学习此类策略,AgentIAD采用两阶段训练策略:首先通过工具感知监督微调初始化结构化推理和记忆访问行为,随后通过代理强化学习优化长周期决策策略。大量实验表明,在相同主干网络下,AgentIAD在MMAD基准上比先前最先进的方法提高了5.92%的分类准确率,同时提供了更可靠和可解释的异常分析。

英文摘要:

Industrial anomaly detection (IAD) is challenging due to the subtle and highly localized nature of many defects, which single-pass vision--language models (VLMs) often fail to capture. Moreover, existing approaches lack mechanisms to actively acquire complementary evidence during inference. We propose AgentIAD, an agentic vision--language framework that enables iterative industrial inspection through a unified action space. The agent dynamically accesses two forms of memory during inspection: visual memory via the Perceptive Zoomer (PZ) for fine-grained local analysis, and retrieved memory via the Web Searcher (WS) and Comparative Retriever (CR) for external knowledge acquisition and cross-instance verification. This design allows the model to progressively gather evidence through multi-round perception--action reasoning. To effectively learn such policies under sparse supervision, AgentIAD adopts a two-stage training strategy: tool-aware supervised fine-tuning first initializes structured reasoning and memory-access behaviors, followed by agentic reinforcement learning to refine long-horizon decision policies. Extensive experiments show that, under the same backbone, AgentIAD improves classification accuracy by 5.92% over the previous state-of-the-art method on the MMAD benchmark while providing more reliable and interpretable anomaly analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑