arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.14683cs.CV
收藏

IntrinsicNGP:基于人类内部坐标的散列编码NeRF

IntrinsicNGP: Intrinsic Coordinate based Hash Encoding for Human NeRF

University of Science and Technology of China(中国科学技术大学)

Bo Peng, Jun Hu, Jingtao Zhou, Xuan Gao, Juyong Zhang

摘要:

最近,许多工作已经提出利用神经辐射场的人类表演者的新的视图合成。然而,这些方法中的大多数需要数小时的培训,使得它们难以实际使用。为了解决这个具有挑战性的问题,我们提出了IntrinsicNGP,它可以从头开始训练,并在几分钟内实现高保真度的结果与人类表演者的视频。为了实现这一目标,我们引入了一个连续的和可优化的内在坐标,而不是原来的显式欧几里德坐标的哈希编码模块的即时NGP。有了这个新颖的内在坐标,IntrinsicNGP可以在代理几何形状的帮助下聚合动态对象的帧间信息。此外,使用给定的粗糙几何形状训练的结果可以进一步细化基于内在坐标的可优化偏移字段。在多个数据集上的大量实验结果证明了IntrinsicNGP的有效性和效率。我们还说明了我们的方法的能力,编辑重建的主题的形状。

英文摘要:

Recently, many works have been proposed to utilize the neural radiance field for novel view synthesis of human performers. However, most of these methods require hours of training, making them difficult for practical use. To address this challenging problem, we propose IntrinsicNGP, which can train from scratch and achieve high-fidelity results in few minutes with videos of a human performer. To achieve this target, we introduce a continuous and optimizable intrinsic coordinate rather than the original explicit Euclidean coordinate in the hash encoding module of instant-NGP. With this novel intrinsic coordinate, IntrinsicNGP can aggregate inter-frame information for dynamic objects with the help of proxy geometry shapes. Moreover, the results trained with the given rough geometry shapes can be further refined with an optimizable offset field based on the intrinsic coordinate.Extensive experimental results on several datasets demonstrate the effectiveness and efficiency of IntrinsicNGP. We also illustrate our approach's ability to edit the shape of reconstructed subjects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑