arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.05550cs.CV
收藏

回到功能:经典3D特征(几乎)是3D异常检测所需的全部

Back to the Feature: Classical 3D Features are (Almost) All You Need for 3D Anomaly Detection

The Hebrew University of Jerusalem(耶路撒冷希伯来大学)

Eliahu Horwitz, Yedid Hoshen

摘要:

尽管在图像异常检测和分割方面取得了重大进展,但很少有方法使用3D信息。我们利用最近推出的3D异常检测数据集来评估是否使用3D信息是一个失去的机会。首先,我们提出了一个令人惊讶的发现:标准的仅颜色方法优于所有明确设计用于利用3D信息的当前方法。这是违反直觉的,因为即使对数据集进行简单的检查也表明,仅使用颜色的方法对于包含几何异常的图像是不够的。这引发了一个问题:异常检测方法如何有效地使用3D信息?我们研究了一系列形状表示,包括手工制作和基于深度学习的形状表示;我们证明了旋转不变性在性能中起着主导作用。我们发现了一种简单的3D方法,它击败了所有最近的方法,同时不使用深度学习,外部预训练数据集或颜色信息。由于仅3D的方法无法检测颜色和纹理异常,我们将其与基于颜色的特征相结合,显著优于以前的最先进技术。我们的方法,被称为BTF(回到特征),在MVTec 3D-AD上实现了像素级ROCAUC:99.3%和PRO:96.4%。

英文摘要:

Despite significant advances in image anomaly detection and segmentation, few methods use 3D information. We utilize a recently introduced 3D anomaly detection dataset to evaluate whether or not using 3D information is a lost opportunity. First, we present a surprising finding: standard color-only methods outperform all current methods that are explicitly designed to exploit 3D information. This is counter-intuitive as even a simple inspection of the dataset shows that color-only methods are insufficient for images containing geometric anomalies. This motivates the question: how can anomaly detection methods effectively use 3D information? We investigate a range of shape representations including hand-crafted and deep-learning-based; we demonstrate that rotation invariance plays the leading role in the performance. We uncover a simple 3D-only method that beats all recent approaches while not using deep learning, external pre-training datasets, or color information. As the 3D-only method cannot detect color and texture anomalies, we combine it with color-based features, significantly outperforming previous state-of-the-art. Our method, dubbed BTF (Back to the Feature) achieves pixel-wise ROCAUC: 99.3% and PRO: 96.4% on MVTec 3D-AD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑