3D生成式AI的进展与前景:包含3D人体的技术综述
Progress and Prospects in 3D Generative AI: A Technical Overview including 3D human
AI总结:
本文综述了2023年下半年3D生成式AI的进展,涵盖3D对象、人体模型及动作生成,重点探讨了stable diffusion、SMPL-X、NeRF和3DGS等技术的推动作用及未来展望。
摘要:
随着AI生成的文本和2D图像不断扩大其领域,3D生成已逐渐成为一种不可忽视的趋势。自2023年以来,3D生成领域涌现了大量研究论文。这种增长不仅包括3D对象的创建,还包括3D角色和动作生成的快速发展。几个关键因素促成了这一进展。stable diffusion中保真度的提升,加上确保多视图一致性的控制方法,以及像SMPL-X这样逼真的人体模型,协同促进了具有显著一致性和近乎逼真外观的3D模型的产生。基于神经网络的3D存储和渲染模型的进步,如Neural Radiance Fields (NeRF)和3D Gaussian Splatting (3DGS),加速了神经渲染模型的效率和真实感。此外,大型语言模型的多模态能力使语言输入能够转化为人体动作输出。本文旨在对主要在2023年下半年发表的相关论文提供全面的概述和总结。它将首先讨论3D中的AI生成对象模型,接着是生成的3D人体模型,最后是生成的3D人体动作,最终以总结和对未来的展望作为结尾。
英文摘要:
While AI-generated text and 2D images continue to expand its territory, 3D generation has gradually emerged as a trend that cannot be ignored. Since the year 2023 an abundant amount of research papers has emerged in the domain of 3D generation. This growth encompasses not just the creation of 3D objects, but also the rapid development of 3D character and motion generation. Several key factors contribute to this progress. The enhanced fidelity in stable diffusion, coupled with control methods that ensure multi-view consistency, and realistic human models like SMPL-X, contribute synergistically to the production of 3D models with remarkable consistency and near-realistic appearances. The advancements in neural network-based 3D storing and rendering models, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have accelerated the efficiency and realism of neural rendered models. Furthermore, the multimodality capabilities of large language models have enabled language inputs to transcend into human motion outputs. This paper aims to provide a comprehensive overview and summary of the relevant papers published mostly during the latter half year of 2023. It will begin by discussing the AI generated object models in 3D, followed by the generated 3D human models, and finally, the generated 3D human motions, culminating in a conclusive summary and a vision for the future.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。