arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.04552cs.CV
收藏

BoLTVOS:用于视频对象分割的盒级跟踪

BoLTVOS: Box-Level Tracking for Video Object Segmentation

RWTH Aachen University(亚琛工业大学)

Paul Voigtlaender, Jonathon Luiten, Bastian Leibe

摘要:

我们的方法视频对象分割(VOS)的任务分为两个子任务:限界框水平跟踪,其次是限界框分割。遵循这种范式,我们提出了BoLTVOS(VOS的框级跟踪),它由一个R-CNN检测器,条件是第一帧限界框检测感兴趣的对象,时间一致性重新评分算法,以及将边界框转换为分割掩码的Box 2Seg网络。BoLTVOS仅使用第一帧限界框而不使用掩码来执行VOS。我们在DAVIS 2017和YouTube-VOS上评估了我们的方法,并表明它优于所有不执行第一帧微调的方法。我们进一步提出了BoLTVOS-ft,它学习使用第一帧掩码在跟踪时分割有问题的对象,而不增加运行时间。BoLTVOS-ft的性能优于PReMVOS,后者是DAVIS 2016和YouTube-VOS上之前性能最好的VOS方法,同时运行速度快了45倍。我们的限界框跟踪器在限界框级跟踪数据集OTB 2015和LTB 35上的性能也优于所有以前的短期和长期跟踪器。这个作品的更新版本可以在arXiv:1911.12836找到。

英文摘要:

We approach video object segmentation (VOS) by splitting the task into two sub-tasks: bounding box level tracking, followed by bounding box segmentation. Following this paradigm, we present BoLTVOS (Box-Level Tracking for VOS), which consists of an R-CNN detector conditioned on the first-frame bounding box to detect the object of interest, a temporal consistency rescoring algorithm, and a Box2Seg network that converts bounding boxes to segmentation masks. BoLTVOS performs VOS using only the firstframe bounding box without the mask. We evaluate our approach on DAVIS 2017 and YouTube-VOS, and show that it outperforms all methods that do not perform first-frame fine-tuning. We further present BoLTVOS-ft, which learns to segment the object in question using the first-frame mask while it is being tracked, without increasing the runtime. BoLTVOS-ft outperforms PReMVOS, the previously best performing VOS method on DAVIS 2016 and YouTube-VOS, while running up to 45 times faster. Our bounding box tracker also outperforms all previous short-term and longterm trackers on the bounding box level tracking datasets OTB 2015 and LTB35. A newer version of this work can be found at arXiv:1911.12836.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑