arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2312.04521cs.CV

基于跨模态特征映射的多模态工业异常检测

Multimodal Industrial Anomaly Detection by Crossmodal Feature Mapping

University of Bologna(博洛尼亚大学);CVLAB(计算机视觉实验室)

Alex Costanzino, Pierluigi Zama Ramirez, Giuseppe Lisanti, Luigi Di Stefano

AI总结:

针对工业多模态异常检测任务,提出轻量快速的跨模态特征映射框架及层剪枝技术,在MVTec 3D-AD数据集上实现了更优性能与更高效率。

摘要:

本文研究工业多模态异常检测(AD)任务,该任务利用点云和RGB图像定位异常。我们提出了一种新颖的轻量快速框架,该框架学习在正常样本上将一种模态的特征映射到另一种模态。测试时,通过定位观测特征与映射特征之间的不一致来检测异常。大量实验表明,我们的方法在MVTec 3D-AD数据集的标准设置和少样本设置下均实现了最优的检测和分割性能,同时相比以往的多模态AD方法推理速度更快、内存占用更少。此外,我们提出了一种层剪枝技术,可在性能牺牲极小的情况下提升内存和时间效率。

英文摘要:

The paper explores the industrial multimodal Anomaly Detection (AD) task, which exploits point clouds and RGB images to localize anomalies. We introduce a novel light and fast framework that learns to map features from one modality to the other on nominal samples. At test time, anomalies are detected by pinpointing inconsistencies between observed and mapped features. Extensive experiments show that our approach achieves state-of-the-art detection and segmentation performance in both the standard and few-shot settings on the MVTec 3D-AD dataset while achieving faster inference and occupying less memory than previous multimodal AD methods. Moreover, we propose a layer-pruning technique to improve memory and time efficiency with a marginal sacrifice in performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑