arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.06205eess.IV
收藏

学习编码孔径时分复用光场显示

Time-Division Multiplexing Light Field Display with Learned Coded Aperture

Chun-Hao Chao, Chang-Le Liu, Homer Chen

摘要:

传统的立体显示器存在聚散度-调节冲突,导致视觉疲劳。基于集成成像的显示器通过使用微透镜阵列或类似结构将光场的子孔径视图直接投影到眼睛中来解决该问题。然而,这样的显示器在角度和空间分辨率之间具有固有的折衷。在本文中,我们提出了一种新的编码时分复用技术,项目编码的子孔径视图的观众的眼睛与正确的线索聚散调节反射。给定稀疏光场子孔径视图,我们的流水线可以通过联合优化用于显示的子孔径视图和编码孔径图案来提供具有最小混叠的高分辨率重聚焦图像的感知。这是通过端到端方式的深度学习来实现的,通过傅立叶光学模拟光传输和图像形成。据我们所知,这项工作是第一个使用深度学习优化光场显示管道的工作。我们用客观的图像质量指标(PSNR,SSIM和LPIPS)验证了我们的想法,并对我们的显示管道中的各种可定制的设计变量进行了广泛的研究。实验结果表明,使用所提出的技术显示的光场确实有更高的质量比基线显示设计。

英文摘要:

Conventional stereoscopic displays suffer from vergence-accommodation conflict and cause visual fatigue. Integral-imaging-based displays resolve the problem by directly projecting the sub-aperture views of a light field into the eyes using a microlens array or a similar structure. However, such displays have an inherent trade-off between angular and spatial resolutions. In this paper, we propose a novel coded time-division multiplexing technique that projects encoded sub-aperture views to the eyes of a viewer with correct cues for vergence-accommodation reflex. Given sparse light field sub-aperture views, our pipeline can provide a perception of high-resolution refocused images with minimal aliasing by jointly optimizing the sub-aperture views for display and the coded aperture pattern. This is achieved via deep learning in an end-to-end fashion by simulating light transport and image formation with Fourier optics. To our knowledge, this work is among the first that optimize the light field display pipeline with deep learning. We verify our idea with objective image quality metrics (PSNR, SSIM, and LPIPS) and perform an extensive study on various customizable design variables in our display pipeline. Experimental results show that light fields displayed using the proposed technique indeed have higher quality than that of baseline display designs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑