arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.11540cs.CV
收藏

学习视频对象分割要学习的内容

Learning What to Learn for Video Object Segmentation

ETH Zürich(苏黎世联邦理工学院);Linköping University(林雪平大学)

Goutam Bhat, Felix Järemo Lawin, Martin Danelljan, Andreas Robinson, Michael Felsberg, Luc Van Gool, Radu Timofte

摘要:

视频对象分割(VOS)是一个非常具有挑战性的问题,因为目标对象只定义在推理与给定的第一帧参考掩码。如何获取和利用这些有限的目标信息仍然是一个基本的研究问题。我们通过引入端到端可训练的VOS架构来解决这个问题,该架构集成了可区分的少样本学习模块。该内部学习器旨在通过最小化第一帧中的分割错误来预测目标的强大参数模型。我们通过学习Few-Shot学习器应该学习的内容,进一步超越了标准的Few-Shot学习技术。这使我们能够在当前帧中实现目标的丰富内部表示,显着提高了我们方法的分割精度。我们在多个基准上进行了广泛的实验。我们的方法在大规模YouTube-VOS 2018数据集上设置了一个新的最先进的水平,获得了81.5的总分,比之前的最佳结果相对提高了2.6%。

英文摘要:

Video object segmentation (VOS) is a highly challenging problem, since the target object is only defined during inference with a given first-frame reference mask. The problem of how to capture and utilize this limited target information remains a fundamental research question. We address this by introducing an end-to-end trainable VOS architecture that integrates a differentiable few-shot learning module. This internal learner is designed to predict a powerful parametric model of the target by minimizing a segmentation error in the first frame. We further go beyond standard few-shot learning techniques by learning what the few-shot learner should learn. This allows us to achieve a rich internal representation of the target in the current frame, significantly increasing the segmentation accuracy of our approach. We perform extensive experiments on multiple benchmarks. Our approach sets a new state-of-the-art on the large-scale YouTube-VOS 2018 dataset by achieving an overall score of 81.5, corresponding to a 2.6% relative improvement over the previous best result.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑