arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.19175cs.LGcs.CV
收藏

使用模拟数据以减少用于缺陷检测的数据获取与标注

Towards Reducing Data Acquisition and Labeling for Defect Detection using Simulated Data

Fraunhofer Institute for Integrated Circuits IIS(弗劳恩霍夫集成电路研究所);Fraunhofer Development Center X-Ray Technology EZRT(弗劳恩霍夫X射线技术开发中心EZRT)

Lukas Malte Kemeter, Rasmus Hvingelby, Paulina Sierak, Tobias Schön, Bishwajit Gosswam

AI总结:

针对制造场景中缺陷检测的数据标注成本高及合成与真实数据间的领域偏移问题,本文提出利用模拟与真实X射线图像混合训练目标检测模型,发现sim-2-real领域自适应方法在固定样本数下比全监督模型更具成本效益。

摘要:

在许多制造场景中,为机器学习和计算机视觉标注数据的成本很高,但合成数据的生成成本却低得多。因此,对于需要大量训练数据的机器学习应用而言,用合成数据替代真实数据极具吸引力。然而,仅依赖合成数据通常不足以有效训练在真实数据上表现良好的模型,这主要是由于合成数据与真实数据之间存在领域偏移。我们探讨了在检测铝制车轮的 X 射线扫描中的缺陷时,处理此类领域偏移的方法。我们使用模拟和真实的 X 射线图像,采用不同策略训练目标检测模型,以确定在最小化对标注真实训练样本需求的同时,能产生最佳检测结果的训练方法。我们的初步发现表明,如果可用标注样本总数固定,sim-2-real 领域自适应方法比完全监督的 oracle 模型更具成本效益。给定一定数量的已标注真实样本,在合成数据与未标注真实数据的混合集上进行训练,能以显著更低的成本取得相当甚至更好的检测结果。我们认为,未来对不同训练策略成本效益的研究对于更好地理解如何在实际机器学习项目中分配预算具有重要意义。

英文摘要:

In many manufacturing settings, annotating data for machine learning and computer vision is costly, but synthetic data can be generated at significantly lower cost. Substituting the real-world data with synthetic data is therefore appealing for many machine learning applications that require large amounts of training data. However, relying solely on synthetic data is frequently inadequate for effectively training models that perform well on real-world data, primarily due to domain shifts between the synthetic and real-world data. We discuss approaches for dealing with such a domain shift when detecting defects in X-ray scans of aluminium wheels. Using both simulated and real-world X-ray images, we train an object detection model with different strategies to identify the training approach that generates the best detection results while minimising the demand for annotated real-world training samples. Our preliminary findings suggest that the sim-2-real domain adaptation approach is more cost-efficient than a fully supervised oracle - if the total number of available annotated samples is fixed. Given a certain number of labeled real-world samples, training on a mix of synthetic and unlabeled real-world data achieved comparable or even better detection results at significantly lower cost. We argue that future research into the cost-efficiency of different training strategies is important for a better understanding of how to allocate budget in applied machine learning projects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑