arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.02707cs.CV
收藏

多边形标注中不确定性及质量保证影响的实证研究

An Empirical Study of Uncertainty in Polygon Annotation and the Impact of Quality Assurance

Sama

Eric Zimmermann, Justin Szeto, Frederic Ratle

AI总结:

针对现实标注项目对像素级精度的需求,该研究通过分析MS-COCO数据集多标注者多边形标注,量化了多边形标注的固有不确定性,验证了审核流程、场景与形状复杂度对标注可靠性的影响。

摘要:

多边形是实例分割任务中用于快速标注对象的常见标注格式。然而,许多现实世界的标注项目要求接近像素级完美的标签。尽管严格的像素标注指南看似是项目成功的解决方案,但从业者往往未能评估所要求工作的可行性,且忽略了可能对质量概念构成挑战的常见因素。本文旨在检验并量化多边形标注的固有不确定性,以及质量保证在最小化其影响方面的作用。为此,我们对来自MS-COCO数据集的多个对象的多标注者多边形标注进行了分析。结果表明,多边形标注的可靠性取决于审核流程,以及场景和形状的复杂度。

英文摘要:

Polygons are a common annotation format used for quickly annotating objects in instance segmentation tasks. However, many real-world annotation projects request near pixel-perfect labels. While strict pixel guidelines may appear to be the solution to a successful project, practitioners often fail to assess the feasibility of the work requested, and overlook common factors that may challenge the notion of quality. This paper aims to examine and quantify the inherent uncertainty for polygon annotations and the role that quality assurance plays in minimizing its effect. To this end, we conduct an analysis on multi-rater polygon annotations for several objects from the MS-COCO dataset. The results demonstrate that the reliability of a polygon annotation is dependent on a reviewing procedure, as well as the scene and shape complexity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑