arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.04403cs.CVcs.CLcs.MM
收藏

SynthRef:用于对象分割的合成指称表达式的生成

SynthRef: Generation of Synthetic Referring Expressions for Object Segmentation

Universitat Politècnica de Catalunya(加泰罗尼亚理工大学);National Technical University of Athens(雅典国立技术大学);Universitat Oberta de Catalunya(加泰罗尼亚开放大学);Barcelona Supercomputing Center(巴塞罗那超级计算中心);University of Stuttgart(斯图加特大学)

Ioannis Kazakos, Carles Ventura, Miriam Bellver, Carina Silberer, Xavier Giro-i-Nieto

摘要:

深度学习的最新进展为视觉基础任务带来了重大进展,例如语言引导的视频对象分割。然而,为这些任务收集大型数据集在注释时间方面是昂贵的,这是一个瓶颈。为此,我们提出了一种新的方法,即SynthRef,用于生成合成参考表达式的图像(或视频帧)中的目标对象,我们还提出和传播的第一个大规模的数据集与合成参考表达式的视频对象分割。我们的实验表明,通过使用我们的合成引用表达式进行训练,可以提高模型在不同数据集上泛化的能力,而无需任何额外的注释成本。此外,我们的配方允许其应用到任何目标检测或分割数据集。

英文摘要:

Recent advances in deep learning have brought significant progress in visual grounding tasks such as language-guided video object segmentation. However, collecting large datasets for these tasks is expensive in terms of annotation time, which represents a bottleneck. To this end, we propose a novel method, namely SynthRef, for generating synthetic referring expressions for target objects in an image (or video frame), and we also present and disseminate the first large-scale dataset with synthetic referring expressions for video object segmentation. Our experiments demonstrate that by training with our synthetic referring expressions one can improve the ability of a model to generalize across different datasets, without any additional annotation cost. Moreover, our formulation allows its application to any object detection or segmentation dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑