arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.01153cs.CV
收藏

视频分割中的深度学习技术综述

A Survey on Deep Learning Technique for Video Segmentation

ETH Zurich(苏黎世联邦理工学院);Australian National University(澳大利亚国立大学);Indiana University(印第安纳大学);University of Technology Sydney(悉尼科技大学)

Tianfei Zhou, Fatih Porikli, David Crandall, Luc Van Gool, Wenguan Wang

摘要:

视频分割-将视频帧分割成多个片段或对象-在广泛的实际应用中发挥着关键作用,从增强电影中的视觉效果,到理解自动驾驶中的场景,再到在视频会议中创建虚拟背景。最近,随着计算机视觉中连接主义的复兴,基于深度学习的视频分割方法大量涌现,这些方法具有令人信服的性能。在这篇综述中,我们通过介绍各自的任务设置、背景概念、感知需求、发展历史和主要挑战,全面回顾了两条基本研究路线--视频中的通用对象分割(未知类别)和视频语义分割。我们还提供了方法和数据集的代表性文献的详细概述。我们进一步基准审查的方法在几个著名的数据集。最后,我们指出在这一领域的开放问题,并建议进一步研究的机会。我们还提供了一个公共网站,以持续跟踪这个快速发展的领域的发展:https://github.com/tfzhou/VS-Survey。

英文摘要:

Video segmentation -- partitioning video frames into multiple segments or objects -- plays a critical role in a broad range of practical applications, from enhancing visual effects in movie, to understanding scenes in autonomous driving, to creating virtual background in video conferencing. Recently, with the renaissance of connectionism in computer vision, there has been an influx of deep learning based approaches for video segmentation that have delivered compelling performance. In this survey, we comprehensively review two basic lines of research -- generic object segmentation (of unknown categories) in videos, and video semantic segmentation -- by introducing their respective task settings, background concepts, perceived need, development history, and main challenges. We also offer a detailed overview of representative literature on both methods and datasets. We further benchmark the reviewed methods on several well-known datasets. Finally, we point out open issues in this field, and suggest opportunities for further research. We also provide a public website to continuously track developments in this fast advancing field: https://github.com/tfzhou/VS-Survey.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑