arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.00814eess.IVcs.CV
收藏

基于深度学习与计算机图形学的单次条纹投影轮廓测量

Single-shot fringe projection profilometry based on Deep Learning and Computer Graphics

Southeast University(东南大学);University College London(伦敦大学学院)

Fanzhou Wang, Chenxing Wang, Qingze Guan

AI总结:

本文引入计算机图形学构建虚拟FPP系统生成数据集,设计新损失函数并比较U-Net与pix2pix网络,实现从单幅条纹图像准确估计深度图像,实验证明该方法具有良好的准确性与泛化能力。

摘要:

近年来,多项研究将深度学习应用于条纹投影轮廓测量(FPP)。然而,从实际系统中获取大量训练数据仍是一个棘手问题,且网络设计与优化仍值得探索。本文引入计算机图形学构建虚拟FPP系统,以便便捷简单地生成所需数据集。首先详细描述了虚拟FPP系统的构建方法,随后分析了使虚拟FPP系统接近现实的关键因素。旨在仅从单幅条纹图像准确估计深度图像,我们还设计了新的损失函数以增强整体与细节信息的恢复质量。并从多方面比较了U-Net和pix2pix两个代表性网络。真实实验证明了由虚拟系统数据与所设计损失训练的网络具有良好的准确性与泛化能力,表明本方法的应用潜力。

英文摘要:

Multiple works have applied deep learning to fringe projection profilometry (FPP) in recent years. However, to obtain a large amount of data from actual systems for training is still a tricky problem, and moreover, the network design and optimization still worth exploring. In this paper, we introduce computer graphics to build virtual FPP systems in order to generate the desired datasets conveniently and simply. The way of constructing a virtual FPP system is described in detail firstly, and then some key factors to set the virtual FPP system much close to the reality are analyzed. With the aim of accurately estimating the depth image from only one fringe image, we also design a new loss function to enhance the quality of the overall and detailed information restored. And two representative networks, U-Net and pix2pix, are compared in multiple aspects. The real experiments prove the good accuracy and generalization of the network trained by the data from our virtual systems and the designed loss, implying the potential of our method for applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑