SVI360:球面视频插值
SVI360: Spherical Video Interpolation
浏览论文内容
中文总结 AI 辅助
针对全向视频插值问题,提出双分支框架SVI360,结合图像帧及其旋转正交视图处理失真,增强原始视图与正交视图间流位移等变性改进中间帧预测,在插值质量上优于现有方法。
中文摘要 AI 辅助
本文探讨全向视频插值问题,其在虚拟现实和沉浸式视频增强等应用中至关重要。现有视频插值方法不适用于球面视频,因其难以处理两极附近的严重失真。为此提出SVI360,这是一个双分支框架,结合图像帧及其旋转正交视图处理失真。该方法核心是增强原始视图与正交视图间流位移的等变性以改进中间帧预测。实验表明,该方法在四个不同公共基准测试中,插值质量优于现有方法,同时保持准确光流。
英文摘要
This paper addresses the problem of omnidirectional video interpolation, which plays an essential role in applications such as virtual reality and immersive video enhancement. Existing video interpolation methods are not well-suited for spherical videos, as they have difficulty handling severe distortions close to the poles. To address this issue, we propose SVI360, a dual-branch framework that combines the image frame and its rotated orthogonal view to deal with these distortions. The core methodological aspect of the approach is to reinforce equivariance of the flow displacements between the original and orthogonal views to improve intermediate frame prediction. Experiments show that our method outperforms state-of-the-art approaches in interpolation quality while maintaining accurate optical flow in four different public benchmarks. Code and pre-trained models are available at: https://icb-vision-ai.github.io/video360_interpolation/
发表机构
- Université Bourgogne Europe, ICB UMR 6303 CNRS, France(法国布尔格ogne欧洲大学,ICB UMR 6303 CNRS)
- Université de Picardie Jules Verne, MIS UR 4290, France(法国皮卡第-朱尔斯·维尔纳大学,MIS UR 4290)
机构由 AI 辅助整理,请以论文原文为准。