arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1806.07527cs.CV
收藏

Fluid Annotation:一种用于全图像标注的人机协作接口

Fluid Annotation: A Human-Machine Collaboration Interface for Full Image Annotation

Google Research(谷歌研究院)

Mykhaylo Andriluka, Jasper R. R. Uijlings, Vittorio Ferrari

摘要:

我们引入了Fluid Annotation,这是一个直观的人机协作界面,用于注释图像中每个对象和背景区域的类标签和轮廓。Fluid标注基于三个原则:(I)强大的机器学习辅助。我们从一个强神经网络模型的输出开始,注释者可以通过纠正现有区域的标签,添加新的区域来覆盖丢失的对象,以及删除不正确的区域来编辑该模型。编辑操作也由模型辅助。(II)在一个单一的通道完整的图像注释。相对于孤立地执行一系列小的注释任务,我们提出了一个统一的接口,在一个单一的通行证完整的图像注释。(III)赋予注释者权力。我们授权注释者选择注释什么以及注释的顺序。这使得人们能够专注于机器还不知道的事情,也就是说,只把人类的努力放在它所犯的错误上。这有助于有效地使用注释预算。通过对COCO+Stuff数据集的大量实验,我们证明了Fluid Annotation可以非常有效地实现准确的注释,比流行的LabelMe接口节省三倍的注释时间。

英文摘要:

We introduce Fluid Annotation, an intuitive human-machine collaboration interface for annotating the class label and outline of every object and background region in an image. Fluid annotation is based on three principles: (I) Strong Machine-Learning aid. We start from the output of a strong neural network model, which the annotator can edit by correcting the labels of existing regions, adding new regions to cover missing objects, and removing incorrect regions. The edit operations are also assisted by the model. (II) Full image annotation in a single pass. As opposed to performing a series of small annotation tasks in isolation, we propose a unified interface for full image annotation in a single pass. (III) Empower the annotator. We empower the annotator to choose what to annotate and in which order. This enables concentrating on what the machine does not already know, i.e. putting human effort only on the errors it made. This helps using the annotation budget effectively. Through extensive experiments on the COCO+Stuff dataset, we demonstrate that Fluid Annotation leads to accurate annotations very efficiently, taking three times less annotation time than the popular LabelMe interface.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑