表面HOF:基于高阶函数网络的单幅图像表面重建
Surface HOF: Surface Reconstruction from a Single Image Using Higher Order Function Networks
摘要:
我们解决的问题,从一个单一的图像生成一个高分辨率的表面重建。我们的方法是学习一个高阶函数(HOF),它将对象的图像作为输入并生成映射函数。映射函数从规范域(例如单位球)获取样本,并将每个样本映射到对象的3D重建上的局部切平面。每个切平面被表示为原点和该点处的法向量。通过有效地学习连续映射函数,与生成固定分辨率输出的其他方法相比,可以以任意分辨率生成表面。我们提出了表面HOF,其中高阶函数和映射函数都表示为神经网络,并训练网络生成PointNet对象的重建。实验表明,表面HOF是更准确,使用更有效的表示比其他国家的最先进的方法进行表面重建。表面HOF也更容易训练:它需要最少的输入预处理和输出后处理,并生成更有效的参数表面表示。它的准确性和方便性使表面HOF的一个有吸引力的方法为单图像重建。
英文摘要:
We address the problem of generating a high-resolution surface reconstruction from a single image. Our approach is to learn a Higher Order Function (HOF) which takes an image of an object as input and generates a mapping function. The mapping function takes samples from a canonical domain (e.g. the unit sphere) and maps each sample to a local tangent plane on the 3D reconstruction of the object. Each tangent plane is represented as an origin point and a normal vector at that point. By efficiently learning a continuous mapping function, the surface can be generated at arbitrary resolution in contrast to other methods which generate fixed resolution outputs. We present the Surface HOF in which both the higher order function and the mapping function are represented as neural networks, and train the networks to generate reconstructions of PointNet objects. Experiments show that Surface HOF is more accurate and uses more efficient representations than other state of the art methods for surface reconstruction. Surface HOF is also easier to train: it requires minimal input pre-processing and output post-processing and generates surface representations that are more parameter efficient. Its accuracy and convenience make Surface HOF an appealing method for single image reconstruction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。