arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.13892cs.CVeess.IV
收藏

一种新颖的鱼眼视频视角自适应运动补偿技术

A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video

Friedrich-Alexander University Erlangen-Nürnberg (FAU)(埃尔朗根-纽伦堡弗里德里希-亚历山大大学)

Andy Regensky, Christian Herglotz, André Kaup

摘要:

虽然鱼眼相机由于其大视场而在许多应用领域中需求很高,但是许多图像和视频信号处理任务(诸如运动补偿)遭受所引入的强径向失真。最近提出的基于投影的方法考虑到鱼眼投影,以改善鱼眼运动补偿。然而,该方法没有考虑鱼眼镜头的大视场,其需要考虑3D空间中的不同运动平面。我们提出了一种新的视口自适应运动补偿技术,适用于在不同的视角视口的运动矢量,以实现这些运动平面。因此,一些像素被映射到所谓的虚拟图像平面,并且需要特殊处理以获得透视视口和原始鱼眼图像之间的可靠映射。虽然国家的最先进的超广角补偿是足够准确的,我们提出了一个虚拟的图像平面补偿,导致完美的映射。总而言之,与鱼眼运动补偿的最新技术相比,我们在PSNR方面实现了+2.40 dB的平均增益。

英文摘要:

Although fisheye cameras are in high demand in many application areas due to their large field of view, many image and video signal processing tasks such as motion compensation suffer from the introduced strong radial distortions. A recently proposed projection-based approach takes the fisheye projection into account to improve fisheye motion compensation. However, the approach does not consider the large field of view of fisheye lenses that requires the consideration of different motion planes in 3D space. We propose a novel viewport-adaptive motion compensation technique that applies the motion vectors in different perspective viewports in order to realize these motion planes. Thereby, some pixels are mapped to so-called virtual image planes and require special treatment to obtain reliable mappings between the perspective viewports and the original fisheye image. While the state-of-the-art ultra wide-angle compensation is sufficiently accurate, we propose a virtual image plane compensation that leads to perfect mappings. All in all, we achieve average gains of +2.40 dB in terms of PSNR compared to the state of the art in fisheye motion compensation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑