arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.04570cs.CV
收藏

用于无监督多模态异常检测和定位的Eyecandies数据集

The Eyecandies Dataset for Unsupervised Multimodal Anomaly Detection and Localization

Luca Bonfiglioli, Marco Toschi, Davide Silvestri, Nicola Fioraio, Daniele De Gregorio

摘要:

我们提出了Eyecandies,一种用于无监督异常检测和定位的新型合成数据集。程序生成的糖果的照片般逼真的图像在多个闪电条件下在受控环境中呈现,还在工业输送机场景中提供深度和法线图。我们为模型训练和验证提供了无异常的样本,而具有精确地面实况注释的异常实例仅在测试集中提供。该数据集包括10类糖果,每类都显示出不同的挑战,例如复杂的纹理,自遮挡和镜面反射。此外,我们通过随机绘制程序渲染管道的关键参数来实现大的类内变化,这使得可以创建任意数量的具有照片般逼真外观的实例。同样,异常被注入到渲染图中,并自动生成逐像素的注释,克服了人为偏见和可能的不一致。我们相信这个数据集可以鼓励探索解决异常检测任务的原始方法,例如通过组合颜色,深度和法线映射,因为它们不是由大多数现有数据集提供的。事实上,为了证明利用附加信息实际上如何提高检测性能,我们展示了通过训练深度卷积自动编码器来重建不同输入组合所获得的结果。

英文摘要:

We present Eyecandies, a novel synthetic dataset for unsupervised anomaly detection and localization. Photo-realistic images of procedurally generated candies are rendered in a controlled environment under multiple lightning conditions, also providing depth and normal maps in an industrial conveyor scenario. We make available anomaly-free samples for model training and validation, while anomalous instances with precise ground-truth annotations are provided only in the test set. The dataset comprises ten classes of candies, each showing different challenges, such as complex textures, self-occlusions and specularities. Furthermore, we achieve large intra-class variation by randomly drawing key parameters of a procedural rendering pipeline, which enables the creation of an arbitrary number of instances with photo-realistic appearance. Likewise, anomalies are injected into the rendering graph and pixel-wise annotations are automatically generated, overcoming human-biases and possible inconsistencies. We believe this dataset may encourage the exploration of original approaches to solve the anomaly detection task, e.g. by combining color, depth and normal maps, as they are not provided by most of the existing datasets. Indeed, in order to demonstrate how exploiting additional information may actually lead to higher detection performance, we show the results obtained by training a deep convolutional autoencoder to reconstruct different combinations of inputs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑