arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.01294cs.CVcs.LGeess.IV
收藏

3DVSR:三维EPI基于体积的角度和空间光场图像超分辨率方法

3DVSR: 3D EPI Volume-based Approach for Angular and Spatial Light field Image Super-resolution

Institute of Parallel and Distributed Systems(并行与分布式系统研究所)

Trung-Hieu Tran, Jan Berberich, Sven Simon

摘要:

光场(LF)成像,捕捉场景的空间和角度信息,无疑是有益的许多应用。虽然已经提出了各种技术用于LF采集,但实现角度和空间高分辨率LF仍然是一个技术挑战。本文提出了一种基于学习的方法,应用于三维核线图像(EPI)重建高分辨率LF。通过2级超分辨率框架,所提出的方法有效地解决了各种LF超分辨率(SR)问题,即,空间SR、角度SR和角度-空间SR。虽然第一级提供了灵活的选项来将EPI体积上采样到期望的分辨率,但是由新颖的基于EPI体积的细化网络(EVRN)组成的第二级实质上增强了高分辨率EPI体积的质量。对来自7个已发表数据集的90个具有挑战性的合成和真实世界光场场景的广泛评估表明,所提出的方法在很大程度上优于空间和角度超分辨率问题的最新方法,即,空间SR $\times 2$、空间SR $\times 4$和角度SR的平均峰值信噪比改善分别超过2.0 dB、1.4 dB和3.14 dB。重建的4D光场在所有透视图像中表现出平衡的性能分布,并与以前的作品相比呈现出优异的视觉质量。

英文摘要:

Light field (LF) imaging, which captures both spatial and angular information of a scene, is undoubtedly beneficial to numerous applications. Although various techniques have been proposed for LF acquisition, achieving both angularly and spatially high-resolution LF remains a technology challenge. In this paper, a learning-based approach applied to 3D epipolar image (EPI) is proposed to reconstruct high-resolution LF. Through a 2-stage super-resolution framework, the proposed approach effectively addresses various LF super-resolution (SR) problems, i.e., spatial SR, angular SR, and angular-spatial SR. While the first stage provides flexible options to up-sample EPI volume to the desired resolution, the second stage, which consists of a novel EPI volume-based refinement network (EVRN), substantially enhances the quality of the high-resolution EPI volume. An extensive evaluation on 90 challenging synthetic and real-world light field scenes from 7 published datasets shows that the proposed approach outperforms state-of-the-art methods to a large extend for both spatial and angular super-resolution problem, i.e., an average peak signal to noise ratio improvement of more than 2.0 dB, 1.4 dB, and 3.14 dB in spatial SR $\times 2$, spatial SR $\times 4$, and angular SR respectively. The reconstructed 4D light field demonstrates a balanced performance distribution across all perspective images and presents superior visual quality compared to the previous works.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑