Despite significant advances in image anomaly detection and segmentation, few methods use 3D information. We utilize a recently introduced 3D anomaly detection dataset to evaluate whether or not using 3D information is a lost opportunity. First, we present a surprising finding: standard color-only methods outperform all current methods that are explicitly designed to exploit 3D information. This is counter-intuitive as even a simple inspection of the dataset shows that color-only methods are insufficient for images containing geometric anomalies. This motivates the question: how can anomaly detection methods effectively use 3D information? We investigate a range of shape representations including hand-crafted and deep-learning-based; we demonstrate that rotation invariance plays the leading role in the performance. We uncover a simple 3D-only method that beats all recent approaches while not using deep learning, external pre-training datasets, or color information. As the 3D-only method cannot detect color and texture anomalies, we combine it with color-based features, significantly outperforming previous state-of-the-art. Our method, dubbed BTF (Back to the Feature) achieves pixel-wise ROCAUC: 99.3% and PRO: 96.4% on MVTec 3D-AD.
Nonnegative-Constrained Joint Collaborative Representation with Union Dictionary for Hyperspectral Anomaly Detection
Institute of Advanced Research in Artificial Intelligence (IARAI)(高级人工智能研究所(IARAI));Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心);Helmholtz Institute Freiberg for Resource Technology(亥姆霍兹弗赖贝格资源技术研究所)
Dual-Modality Vehicle Anomaly Detection via Bilateral Trajectory Tracing
Wuhan University(武汉大学)
交通异常检测在智能交通系统(ITS)中起着至关重要的作用。这项任务的主要挑战在于高度多样化的异常场景和多变的照明条件。虽然许多工作已经成功地识别了同质天气和场景中的异常,但很少有人解决复杂的问题。提出了一种基于双模态模块化的异常车辆鲁棒检测方法。我们介绍了一个集成的异常检测框架,包括以下模块:背景建模,车辆跟踪与检测,掩模构造,感兴趣区域(ROI)回溯,和双模态跟踪。具体地说,我们使用背景建模来过滤运动信息,并留下静态信息用于后续的车辆检测。在车辆检测和跟踪模块中,我们采用YOLOv 5和多尺度跟踪来定位异常。此外,我们利用帧间差分和跟踪结果来识别道路,并获得掩模。此外,我们引入了多个相似性估计指标,通过回溯来细化异常周期。最后,我们提出了一个双模态双边跟踪模块,以进一步细化的时间。在NVIDIA 2021 AI City Challenge的Track 4测试集上进行的实验产生了0.9302 F1-Score和3.4039均方根误差(RMSE)的结果,表明了我们框架的有效性。
FractalAD: A simple industrial anomaly detection method using fractal anomaly generation and backbone knowledge distillation
Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳市人工智能与机器人研究院);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Shanghai Jiaotong University(上海交通大学)
本文提出 FractalAD 工业异常检测方法,通过分形异常生成采样完整异常形态,并利用骨干知识蒸馏提取正常样本先验,以端到端语义分割网络实现高效训练与推理,在 MVTec AD 和 MVTec 3D-AD 数据集上取得有竞争力的结果。
Back to Point: Exploring Point-Language Models for Zero-Shot 3D Anomaly Detection
Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences), Jinan, China(计算机功率网络与信息安全重点实验室,教育部,山东计算机科学中心(济南国家超级计算机中心),齐鲁大学(山东科学院),济南,中国);Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science, Jinan, China(山东省计算功率互联网与服务计算重点实验室,山东省计算机科学基础研究中心,济南,中国)
FB-CLIP: Fine-Grained Zero-Shot Anomaly Detection with Foreground-Background Disentanglement
Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences(西安光学精密机械研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Xi’an Jiaotong University(西安交通大学);Zhongnan Hospital of Wuhan University(武汉大学中南医院)