arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.19441cs.GR
收藏

用于动画与纹理化的 3D Gaussian Model

3D Gaussian Model for Animation and Texturing

Xiangzhi Eric Wang, Zackary P. T. Sin

AI总结:

本文提出 3D Gaussian Model(3DGM),通过纹理空间绑定与隐式壳层映射,使 3D Gaussian Splatting 支持动画驱动、UV 纹理迁移和交互式编辑。

摘要:

3D Gaussian Splatting 通过实现令人瞩目的保真度和性能,已对神经渲染产生了显著影响。然而,尽管取得了这一成就,它并不容易直接用于开发交互式应用。XR 应用和游戏等实时应用需要动画、UV 映射以及模型编辑等功能,并且这些功能要通过使用一个 3D 模型来同时操控。我们提出一种类似于典型 3D 模型的建模方式,称之为 3D Gaussian Model(3DGM);它为新颖动画和纹理迁移提供了一个可操控的代理。通过在纹理空间中绑定 3D 高斯,并借助隐式壳层映射将其重新投影回世界空间,我们展示了我们的 3D 建模如何能够作为一种适用于交互式应用的有效渲染方法。此外还应注意,近期的 3D 网格重建工作已经能够生成用于渲染的高质量网格。相比之下,我们的工作只需要近似几何,即可高保真地渲染对象。在应用方面,我们将展示基于代理的 3DGM 能够在没有动画训练数据的情况下驱动新颖动画,并能够通过 3D 高斯的 UV 映射进行纹理迁移。我们相信,该结果表明我们的工作具有为 3D Gaussian Splatting 赋能交互式应用的潜力。

英文摘要:

3D Gaussian Splatting has made a marked impact on neural rendering by achieving impressive fidelity and performance. Despite this achievement, however, it is not readily applicable to developing interactive applications. Real-time applications like XR apps and games require functions such as animation, UV-mapping, and model editing simultaneously manipulated through the usage of a 3D model. We propose a modeling that is analogous to typical 3D models, which we call 3D Gaussian Model (3DGM); it provides a manipulatable proxy for novel animation and texture transfer. By binding the 3D Gaussians in texture space and re-projecting them back to world space through implicit shell mapping, we show how our 3D modeling can serve as a valid rendering methodology for interactive applications. It is further noted that recently, 3D mesh reconstruction works have been able to produce high-quality mesh for rendering. Our work, on the other hand, only requires an approximated geometry for rendering an object in high fidelity. Applicationwise, we will show that our proxy-based 3DGM is capable of driving novel animation without animated training data and texture transferring via UV mapping of the 3D Gaussians. We believe the result indicates the potential of our work for enabling interactive applications for 3D Gaussian Splatting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑