arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.00908cs.CV
收藏

学习快速鲁棒的视频目标模型

Learning Fast and Robust Target Models for Video Object Segmentation

Linköping University(林雪平大学);ETH Zurich(苏黎世联邦理工学院);IIAI

Andreas Robinson, Felix Järemo Lawin, Martin Danelljan, Fahad Shahbaz Khan, Michael Felsberg

摘要:

视频对象分割(VOS)是一个极具挑战性的问题,因为定义目标对象的初始掩码仅在测试时给出。主要困难是有效地处理外观变化和相似的背景对象,同时保持准确的分割。大多数以前的方法在第一帧上微调分割网络,导致不切实际的帧速率和过拟合的风险。最近的方法集成了生成目标外观模型,但要么实现有限的鲁棒性,要么需要大量的训练数据。我们提出了一种新的VOS架构,由两个网络组件。目标外观模型由一个轻量级模块组成,该模块在推理阶段使用快速优化技术进行学习,以预测粗糙但鲁棒的目标分割。分割模型是专门离线训练的,旨在将粗略的分数处理成高质量的分割掩码。我们的方法是快速的,易于训练,并在有限的训练数据的情况下仍然非常有效。我们在具有挑战性的YouTube-VOS和DAVIS数据集上进行了广泛的实验。我们的网络实现了良好的性能,同时以比最先进的更高的帧速率运行。代码和训练模型可在https://github.com/andr345/frtm-vos上获得。

英文摘要:

Video object segmentation (VOS) is a highly challenging problem since the initial mask, defining the target object, is only given at test-time. The main difficulty is to effectively handle appearance changes and similar background objects, while maintaining accurate segmentation. Most previous approaches fine-tune segmentation networks on the first frame, resulting in impractical frame-rates and risk of overfitting. More recent methods integrate generative target appearance models, but either achieve limited robustness or require large amounts of training data. We propose a novel VOS architecture consisting of two network components. The target appearance model consists of a light-weight module, which is learned during the inference stage using fast optimization techniques to predict a coarse but robust target segmentation. The segmentation model is exclusively trained offline, designed to process the coarse scores into high quality segmentation masks. Our method is fast, easily trainable and remains highly effective in cases of limited training data. We perform extensive experiments on the challenging YouTube-VOS and DAVIS datasets. Our network achieves favorable performance, while operating at higher frame-rates compared to state-of-the-art. Code and trained models are available at https://github.com/andr345/frtm-vos.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑