基于空间-角度密集网络的高效光场重建
Efficient Light Field Reconstruction via Spatio-Angular Dense Network
摘要:
作为一种图像传感手段,光场图像可以提供比单目图像更多的角度信息,从而促进了广泛的测量应用。光场图像捕获设备通常遭受角度和空间分辨率之间的固有权衡。为了解决这个问题,已经提出了几种方法,如光场重建和光场超分辨率,但留下两个问题没有解决,即域不对称和有效的信息流。在本文中,我们提出了一个端到端的空间-角度密集网络(SADenseNet)的光场重建与两个新的组件,即相关块和空间-角度密集跳跃连接来解决它们。前者以符合域不对称性的方式对相关信息进行有效建模。后者由三种连接组成,增强了两个域中的信息流。已经在真实世界和合成数据集上进行了广泛的实验,以证明所提出的SADenseNet的最先进的性能,同时显着降低了内存和计算成本。定性结果表明,重建的光场图像清晰,细节正确,可以作为预处理,以提高相关测量应用的精度。
英文摘要:
As an image sensing instrument, light field images can supply extra angular information compared with monocular images and have facilitated a wide range of measurement applications. Light field image capturing devices usually suffer from the inherent trade-off between the angular and spatial resolutions. To tackle this problem, several methods, such as light field reconstruction and light field super-resolution, have been proposed but leaving two problems unaddressed, namely domain asymmetry and efficient information flow. In this paper, we propose an end-to-end Spatio-Angular Dense Network (SADenseNet) for light field reconstruction with two novel components, namely correlation blocks and spatio-angular dense skip connections to address them. The former performs effective modeling of the correlation information in a way that conforms with the domain asymmetry. And the latter consists of three kinds of connections enhancing the information flow within two domains. Extensive experiments on both real-world and synthetic datasets have been conducted to demonstrate that the proposed SADenseNet's state-of-the-art performance at significantly reduced costs in memory and computation. The qualitative results show that the reconstructed light field images are sharp with correct details and can serve as pre-processing to improve the accuracy of related measurement applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。