arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.03232cs.CV
收藏

深度视频色彩传播

Deep Video Color Propagation

ETH Zurich(苏黎世联邦理工学院);Disney Research(迪士尼研究院)

Simone Meyer, Victor Cornillère, Abdelaziz Djelouah, Christopher Schroers, Markus Gross

摘要:

用于视频中的颜色传播的传统方法依赖于连续视频帧之间的某种形式的匹配。使用外观描述符,颜色,然后传播空间和时间。然而,这些方法在计算上是昂贵的,并且不利用场景的语义信息。在这项工作中,我们提出了一个用于颜色传播的深度学习框架,该框架结合了局部策略和全局策略,该局部策略用于逐帧传播颜色以确保时间稳定性,该全局策略使用语义在更长范围内进行颜色传播。我们的评估表明,我们的策略优于现有的视频和图像的颜色传播方法,以及神经照片逼真的风格转移方法。

英文摘要:

Traditional approaches for color propagation in videos rely on some form of matching between consecutive video frames. Using appearance descriptors, colors are then propagated both spatially and temporally. These methods, however, are computationally expensive and do not take advantage of semantic information of the scene. In this work we propose a deep learning framework for color propagation that combines a local strategy, to propagate colors frame-by-frame ensuring temporal stability, and a global strategy, using semantics for color propagation within a longer range. Our evaluation shows the superiority of our strategy over existing video and image color propagation methods as well as neural photo-realistic style transfer approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑