N-SfC:基于焦散线图像的鲁棒快速形状估计
N-SfC: Robust and Fast Shape Estimation from Caustic Images
摘要:
本文讨论了一个极具挑战性的问题,重建折射物体的形状从一个单一的图像,其产生的焦散。由于透明折射物体在日常生活中无处不在,其形状的重建需要大量的实际应用。最近的形状焦散(SfC)的方法铸造的问题作为逆的光传播模拟的焦散图像的合成,这可以通过可微渲染器解决。然而,通过折射表面的光传输的固有复杂性目前限制了关于重建速度和鲁棒性的实用性。为了解决这些问题,我们引入了焦散神经形状(N-SfC),这是一种基于学习的扩展,它将两个组件集成到重建管道中:去噪模块,它降低了光传输模拟的计算成本,以及基于学习的梯度下降的优化过程,它可以使用更少的迭代实现更好的收敛。大量的实验证明了我们的神经扩展在3D玻璃打印质量控制场景中的有效性,我们在计算速度和最终表面误差方面明显优于当前最先进的水平。
英文摘要:
This paper deals with the highly challenging problem of reconstructing the shape of a refracting object from a single image of its resulting caustic. Due to the ubiquity of transparent refracting objects in everyday life, reconstruction of their shape entails a multitude of practical applications. The recent Shape from Caustics (SfC) method casts the problem as the inverse of a light propagation simulation for synthesis of the caustic image, that can be solved by a differentiable renderer. However, the inherent complexity of light transport through refracting surfaces currently limits the practicability with respect to reconstruction speed and robustness. To address these issues, we introduce Neural-Shape from Caustics (N-SfC), a learning-based extension that incorporates two components into the reconstruction pipeline: a denoising module, which alleviates the computational cost of the light transport simulation, and an optimization process based on learned gradient descent, which enables better convergence using fewer iterations. Extensive experiments demonstrate the effectiveness of our neural extensions in the scenario of quality control in 3D glass printing, where we significantly outperform the current state-of-the-art in terms of computational speed and final surface error.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。