arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.17128cs.CV
收藏

视频帧插值基准测试

Benchmarking Video Frame Interpolation

TU Darmstadt(达姆施塔特工业大学);Adobe Research(奥多比研究院)

Simon Kiefhaber, Simon Niklaus, Feng Liu, Simone Schaub-Meyer

AI总结:

针对视频帧插值评估中数据集繁多、指标不一致及违反线性假设等问题,提出一个包含一致误差指标、逐像素属性分析、符合线性假设的合成测试集及计算效率评估的公平基准。

摘要:

视频帧插值,即在两个或多个给定帧之间合成新帧的任务,正成为日益受欢迎的研究目标。然而,当前对帧插值技术的评估并不理想。由于可用的测试数据集繁多且误差指标的计算不一致,跨论文进行连贯且公平的比较极具挑战性。此外,新的测试集作为方法论文的一部分被提出,因此无法提供专门基准测试论文的深入评估。另一个严重缺陷是,当给定两个输入帧时,这些测试集违反了线性假设,使得没有先验信息便无法解决。因此,我们坚信社区将从一篇基准测试论文中受益匪浅,这正是我们所提出的。具体而言,我们提出了一个基准,它通过利用计算这些指标的提交网站来建立一致的误差指标,通过分析插值质量相对于运动幅度等各种逐像素属性来提供见解,包含通过利用合成数据而遵循线性假设的精心设计的测试集,并以连贯的方式评估计算效率。

英文摘要:

Video frame interpolation, the task of synthesizing new frames in between two or more given ones, is becoming an increasingly popular research target. However, the current evaluation of frame interpolation techniques is not ideal. Due to the plethora of test datasets available and inconsistent computation of error metrics, a coherent and fair comparison across papers is very challenging. Furthermore, new test sets have been proposed as part of method papers so they are unable to provide the in-depth evaluation of a dedicated benchmarking paper. Another severe downside is that these test sets violate the assumption of linearity when given two input frames, making it impossible to solve without an oracle. We hence strongly believe that the community would greatly benefit from a benchmarking paper, which is what we propose. Specifically, we present a benchmark which establishes consistent error metrics by utilizing a submission website that computes them, provides insights by analyzing the interpolation quality with respect to various per-pixel attributes such as the motion magnitude, contains a carefully designed test set adhering to the assumption of linearity by utilizing synthetic data, and evaluates the computational efficiency in a coherent manner.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑