Make-A-Character:数分钟内生成高质量文本到3D角色
Make-A-Character: High Quality Text-to-3D Character Generation within Minutes
AI总结:
针对传统3D角色创建复杂耗时的问题,提出Make-A-Character框架,利用大语言模型和视觉模型,在2分钟内从文本生成可控逼真的3D角色,并支持集成CG管线。
摘要:
随着AI智能体和元宇宙的出现,对定制化和富有表现力的3D角色的需求日益增长,但使用传统计算机图形工具创建3D角色是一项复杂且耗时的任务。为应对这些挑战,我们提出了一个用户友好的框架,名为Make-A-Character(Mach),用于从文本描述创建逼真的3D化身。该框架利用大型语言和视觉模型的能力进行文本意图理解和中间图像生成,随后通过一系列面向人的视觉感知和3D生成模块。我们的系统为用户提供了一种直观的方法,在2分钟内制作出可控、逼真、完整的3D角色,满足他们的期望,同时还能轻松集成到现有的CG管线中,实现动态表现力。更多信息,请访问项目页面:https://human3daigc.github.io/MACH/。
英文摘要:
There is a growing demand for customized and expressive 3D characters with the emergence of AI agents and Metaverse, but creating 3D characters using traditional computer graphics tools is a complex and time-consuming task. To address these challenges, we propose a user-friendly framework named Make-A-Character (Mach) to create lifelike 3D avatars from text descriptions. The framework leverages the power of large language and vision models for textual intention understanding and intermediate image generation, followed by a series of human-oriented visual perception and 3D generation modules. Our system offers an intuitive approach for users to craft controllable, realistic, fully-realized 3D characters that meet their expectations within 2 minutes, while also enabling easy integration with existing CG pipeline for dynamic expressiveness. For more information, please visit the project page at https://human3daigc.github.io/MACH/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。