利用知识图谱和机器学习加速道路标志真值构建
Accelerating Road Sign Ground Truth Construction with Knowledge Graph and Machine Learning
摘要:
拥有一个全面、高质量的道路标志标注数据集对于基于AI的道路标志识别(RSR)系统的成功至关重要。在实践中,注释员在学习不同国家的道路标志系统时往往面临困难;因此,这些任务往往耗时且效果不佳。我们提出了一种新的方法,使用知识图谱和机器学习算法-变分原型编码器(VPE)-来帮助人类注释者有效地分类路标。注释器可以使用视觉属性查询道路标志知识图谱,并接收VPE模型建议的最接近的匹配候选。VPE模型使用来自知识图谱的候选者和真实标志图像块作为输入。我们表明,我们的知识图谱方法可以减少98.9%的符号搜索空间。此外,通过VPE,我们的系统可以为测试数据集中75%的符号提出正确的单个候选,在这些情况下完全消除了人类搜索工作。
英文摘要:
Having a comprehensive, high-quality dataset of road sign annotation is critical to the success of AI-based Road Sign Recognition (RSR) systems. In practice, annotators often face difficulties in learning road sign systems of different countries; hence, the tasks are often time-consuming and produce poor results. We propose a novel approach using knowledge graphs and a machine learning algorithm - variational prototyping-encoder (VPE) - to assist human annotators in classifying road signs effectively. Annotators can query the Road Sign Knowledge Graph using visual attributes and receive closest matching candidates suggested by the VPE model. The VPE model uses the candidates from the knowledge graph and a real sign image patch as inputs. We show that our knowledge graph approach can reduce sign search space by 98.9%. Furthermore, with VPE, our system can propose the correct single candidate for 75% of signs in the tested datasets, eliminating the human search effort entirely in those cases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。