arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2604.22899cs.CV

基于文本引导的多模态统一工业异常检测

Text-Guided Multimodal Unified Industrial Anomaly Detection

School of Computer Science & Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);School of Computing and Information Technology, Great Bay University(海湾大学计算机与信息学院)

Zewen Li, Shuo Ye, Zitong Yu, Weicheng Xie, Linlin Shen

AI总结:

本文提出基于文本语义的多模态统一工业异常检测框架,解决跨模态对齐和几何建模不足问题,通过几何感知跨模态映射和对象条件文本特征适配器实现多模态特征对齐,实现跨类别的准确异常检测。

摘要:

基于RGB-3D多模态数据的工业异常检测已成为智能质量检测的主流范式。然而,现有无监督方法存在两个关键限制:由于缺乏高层语义指导导致的跨模态对齐模糊,以及RGB到3D特征映射的几何建模不足。为解决这些问题,我们提出了一种由文本语义引导的统一多模态工业异常检测框架。该框架包含两个核心模块:几何感知的跨模态映射器,用于在模态转换过程中保留几何结构;以及对象条件的文本特征适配器,用于将多模态特征与语义先验对齐。此外,我们建立了统一的多模态工业异常检测学习范式,打破了单模型单类别的限制,使单个模型能够实现跨多样类别的准确异常检测。在MVTec 3D-AD和Eyecandies数据集上的大量实验表明,我们的方法在无监督设置下实现了分类和定位的最先进性能。

英文摘要:

Industrial anomaly detection based on RGB-3D multimodal data has emerged as a mainstream paradigm for intelligent quality inspection. However, existing unsupervised methods suffer from two critical limitations: ambiguous cross-modal alignment caused by the lack of high-level semantic guidance and insufficient geometric modeling for RGB-to-3D feature mapping. To address these issues, we propose a unified multimodal industrial anomaly detection framework guided by text semantics. The framework consists of two core modules: a Geometry-Aware Cross-Modal Mapper to preserve geometric structure during modality conversion, and an Object-Conditioned Textual Feature Adaptor to align multimodal features with semantic priors. Furthermore, we establish a unified learning paradigm for multimodal industrial anomaly detection, which breaks the one-model-one-class constraint and enables accurate anomaly detection across diverse classes using a single model. Extensive experiments on the MVTec 3D-AD and Eyecandies datasets demonstrate that our method achieves state-of-the-art performance in classification and localization under unsupervised settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑