DAVIDE:深度感知视频去模糊
DAVIDE: Depth-Aware Video Deblurring
AI总结:
本文提出DAVIDE深度感知视频去模糊数据集,研究深度信息注入现有RGB去模糊模型的方式,并构建强基线,证明深度信息可提升去模糊性能但随时间上下文增长而效果减弱。
摘要:
视频去模糊旨在从一系列模糊帧中恢复清晰细节。尽管深度传感器在手机中日益普及,且深度信息具有指导去模糊的潜力,但深度感知去模糊受到的关注仍然有限。在本工作中,我们引入了“深度感知视频去模糊”(DAVIDE)数据集,以研究深度信息在视频去模糊中的影响。该数据集包含同步的模糊、清晰和深度视频。我们研究了应如何将深度信息注入现有的深度RGB视频去模糊模型,并提出了一个用于深度感知视频去模糊的强基线。我们的发现揭示了深度信息在视频去模糊中的重要性,并为深度线索有益的用例提供了见解。此外,我们的结果表明,虽然深度信息能提升去模糊性能,但当模型获得更长的时间上下文时,这种效果会减弱。项目页面:https://germanftv.github.io/DAVIDE.github.io/。
英文摘要:
Video deblurring aims at recovering sharp details from a sequence of blurry frames. Despite the proliferation of depth sensors in mobile phones and the potential of depth information to guide deblurring, depth-aware deblurring has received only limited attention. In this work, we introduce the 'Depth-Aware VIdeo DEblurring' (DAVIDE) dataset to study the impact of depth information in video deblurring. The dataset comprises synchronized blurred, sharp, and depth videos. We investigate how the depth information should be injected into the existing deep RGB video deblurring models, and propose a strong baseline for depth-aware video deblurring. Our findings reveal the significance of depth information in video deblurring and provide insights into the use cases where depth cues are beneficial. In addition, our results demonstrate that while the depth improves deblurring performance, this effect diminishes when models are provided with a longer temporal context. Project page: https://germanftv.github.io/DAVIDE.github.io/ .
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。