arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.01124cs.CV
收藏

用于模糊物体检测的合成图像:一项比较研究

Synthetic imagery for fuzzy object detection: A comparative study

Aalto University(阿尔托大学);Tulane University(杜兰大学)

Siavash H. Khajavi, Mehdi Moshtaghi, Dikai Yu, Zixuan Liu, Kary Främling, Jan Holmström

AI总结:

本文提出基于3D模型生成并自动标注全合成火焰图像的方法,并通过与真实、混合图像训练对比,证明混合训练可提升广泛火灾检测性能并降低建模成本。

摘要:

模糊物体检测是计算机视觉(CV)中一个具有挑战性的研究领域。在CV中区分模糊物体检测与非模糊物体检测十分重要。与树木、汽车等非模糊物体相比,火、烟、薄雾和蒸汽等模糊物体在视觉特征、边缘模糊、形状变化、不透明度和体积方面表现出显著更高的复杂性。收集平衡且多样化的数据集并进行准确标注,对于获得更好的模糊物体机器学习模型至关重要;然而,收集和标注任务仍然高度依赖人工。在本研究中,我们提出并利用一种替代方法,即基于3D模型生成并自动标注全合成火焰图像,用于训练物体检测模型。此外,我们将在合成图像上训练的机器学习模型的性能和效率,与在真实图像和混合图像上训练的机器学习模型进行了比较。研究结果证明了合成数据用于火焰检测的有效性,同时,当测试数据集涵盖更广泛的真实火灾类型时,性能会有所提升。我们的研究结果表明,当合成图像和真实图像用于混合训练集时,所得机器学习模型在检测广泛类型火灾方面,优于仅使用真实图像训练的模型,也优于仅使用合成图像训练的模型。所提出的用于自动化标注合成模糊物体图像的方法,对于减少创建专门用于检测模糊物体的计算机视觉模型所需的时间和成本具有重要意义。

英文摘要:

The fuzzy object detection is a challenging field of research in computer vision (CV). Distinguishing between fuzzy and non-fuzzy object detection in CV is important. Fuzzy objects such as fire, smoke, mist, and steam present significantly greater complexities in terms of visual features, blurred edges, varying shapes, opacity, and volume compared to non-fuzzy objects such as trees and cars. Collection of a balanced and diverse dataset and accurate annotation is crucial to achieve better ML models for fuzzy objects, however, the task of collection and annotation is still highly manual. In this research, we propose and leverage an alternative method of generating and automatically annotating fully synthetic fire images based on 3D models for training an object detection model. Moreover, the performance, and efficiency of the trained ML models on synthetic images is compared with ML models trained on real imagery and mixed imagery. Findings proved the effectiveness of the synthetic data for fire detection, while the performance improves as the test dataset covers a broader spectrum of real fires. Our findings illustrates that when synthetic imagery and real imagery is utilized in a mixed training set the resulting ML model outperforms models trained on real imagery as well as models trained on synthetic imagery for detection of a broad spectrum of fires. The proposed method for automating the annotation of synthetic fuzzy objects imagery carries substantial implications for reducing both time and cost in creating computer vision models specifically tailored for detecting fuzzy objects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑