arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.01330cs.CVcs.GRcs.LGeess.IV
收藏

P-Hologen:一种面向纯相位全息图的端到端生成框架

P-Hologen: An End-to-End Generative Framework for Phase-Only Holograms

Kyung Hee University(庆熙大学);POSTECH;Korea University(韩国大学)

JooHyun Park, YuJin Jeon, HuiYong Kim, SeungHwan Baek, HyeongYeop Kang

AI总结:

本文提出首个面向纯相位全息图的端到端生成框架P-Hologen,通过矢量量化变分自编码器与角谱方法学习相位潜在空间,实现高质量、多样化且高效的全息内容生成。

摘要:

全息技术处于视觉技术的前沿,通过操控光波的振幅和相位提供沉浸式三维可视化。尽管生成模型在图像领域已被广泛探索,但由于相位学习固有的复杂性,其在全息图上的应用仍然相对不足。将生成模型用于全息图为推动创新和创造力提供了令人兴奋的机会,例如语义感知的全息图生成和编辑。目前,在全息图领域利用生成模型最可行的方法是将基于图像的生成模型与图像到全息图的转换模型相结合,但代价是计算复杂度增加且效率低下。为了解决这一问题,我们提出了P-Hologen,这是第一个为纯相位全息图(POHs)设计的端到端生成框架。P-Hologen采用矢量量化变分自编码器来捕捉POHs的复杂分布。它还将角谱方法集成到训练过程中,利用图像处理领域的策略为复杂相位数据构建潜在空间。大量实验表明,与现有方法相比,P-Hologen在质量和计算效率上均具有优越性。此外,我们的模型能够从其学习到的潜在空间中生成高质量、未见过的多样化全息内容,而无需预先存在的图像。我们的工作为全息内容创作中的新应用和新方法铺平了道路,开启了生成式全息内容探索的新时代。本文代码已公开于https://github.com/james0223/P-Hologen。

英文摘要:

Holography stands at the forefront of visual technology, offering immersive, three-dimensional visualizations through the manipulation of light wave amplitude and phase. Although generative models have been extensively explored in the image domain, their application to holograms remains relatively underexplored due to the inherent complexity of phase learning. Exploiting generative models for holograms offers exciting opportunities for advancing innovation and creativity, such as semantic-aware hologram generation and editing. Currently, the most viable approach for utilizing generative models in the hologram domain involves integrating an image-based generative model with an image-to-hologram conversion model, which comes at the cost of increased computational complexity and inefficiency. To tackle this problem, we introduce P-Hologen, the first end-to-end generative framework designed for phase-only holograms (POHs). P-Hologen employs vector quantized variational autoencoders to capture the complex distributions of POHs. It also integrates the angular spectrum method into the training process, constructing latent spaces for complex phase data using strategies from the image processing domain. Extensive experiments demonstrate that P-Hologen achieves superior quality and computational efficiency compared to the existing methods. Furthermore, our model generates high-quality unseen, diverse holographic content from its learned latent space without requiring pre-existing images. Our work paves the way for new applications and methodologies in holographic content creation, opening a new era in the exploration of generative holographic content. The code for our paper is publicly available on https://github.com/james0223/P-Hologen.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑