arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2604.17949cs.CV

ZSG-IAD:一种用于零样本 grounded 工业异常检测的多模态框架

ZSG-IAD: A Multimodal Framework for Zero-Shot Grounded Industrial Anomaly Detection

School of Information Science and Engineering, East China University of Science and Technology(信息科学与工程学院,东华大学)

Qiuhui Chen, Jiaxiang Song, Shuai Tan, Weimin Zhong

AI总结:

本文提出ZSG-IAD框架,通过多模态数据生成结构化异常报告和像素级掩码,采用语言引导的两跳接地模块和可执行规则GRPO提升可靠性,实现在多个工业异常基准上的强零样本性能和透明解释。

摘要:

基于深度学习的工业异常检测器常被视为黑箱,难以用物理有意义的缺陷证据解释决策。我们提出ZSG-IAD,一种用于零样本 grounded 工业异常检测的多模态视觉-语言框架。给定RGB图像、传感器图像和3D点云,ZSG-IAD生成结构化异常报告和像素级异常掩码。ZSG-IAD引入语言引导的两跳接地模块:(1) 与异常相关的句子选择从多模态特征中提取的证据样latent slots,产生粗粒度的空间支持;(2) 选定的slots通过通道-空间门控和轻量解码器调节特征图,生成细粒度掩码。为提高可靠性,我们进一步应用可执行规则GRPO配以可验证奖励,促进结构化输出、异常区域一致性以及推理-结论一致性。在多个工业异常基准上的实验显示,ZSG-IAD在零样本性能和更透明、物理基础的解释方面优于先前方法。我们将发布代码和注释以支持未来可信工业异常检测系统的研究。

英文摘要:

Deep learning-based industrial anomaly detectors often behave as black boxes, making it hard to justify decisions with physically meaningful defect evidence. We propose ZSG-IAD, a multimodal vision-language framework for zero-shot grounded industrial anomaly detection. Given RGB images, sensor images, and 3D point clouds, ZSG-IAD generates structured anomaly reports and pixel-level anomaly masks. ZSG-IAD introduces a language-guided two-hop grounding module: (1) anomaly-related sentences select evidence-like latent slots distilled from multimodal features, yielding coarse spatial support; (2) selected slots modulate feature maps via channel-spatial gating and a lightweight decoder to produce fine-grained masks. To improve reliability, we further apply Executable-Rule GRPO with verifiable rewards to promote structured outputs, anomaly-region consistency, and reasoning-conclusion coherence. Experiments across multiple industrial anomaly benchmarks show strong zero-shot performance and more transparent, physically grounded explanations than prior methods. We will release code and annotations to support future research on trustworthy industrial anomaly detection systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑