ICE:基于对话的交互式3D游戏角色编辑
ICE: Interactive 3D Game Character Editing via Dialogue
AI总结:
针对现有文本驱动角色定制系统仅支持单轮生成、无法进一步编辑的问题,提出ICE框架,通过多轮对话解析和语义引导的低维参数求解,实现细粒度、可迭代的游戏角色编辑,实验验证其有效性和优越性能。
摘要:
目前最流行的角色扮演游戏(RPG)允许玩家通过数百个可调参数来创建游戏内角色,这些参数包括骨骼位置和各种化妆选项。尽管已经开发出文本驱动的自动定制系统来简化调整这些复杂角色参数的繁琐过程,但这些系统受限于单轮生成,缺乏进一步编辑和微调的能力。在本文中,我们提出了一种交互式角色编辑框架(ICE),以实现基于多轮对话的细化过程。简而言之,我们的ICE提供了一种更用户友好的方式,使玩家能够迭代地传达创意想法,同时确保创建的角色符合玩家的期望。具体来说,我们提出了一种指令解析模块(IPM),该模块利用大型语言模型(LLMs)在每一轮中将多轮对话解析为清晰的编辑指令提示。为了可靠且快速地以细粒度级别修改角色控制参数,我们提出了一种语义引导的低维参数求解器(SLPS),该求解器以零样本方式根据提示编辑角色控制参数。我们的SLPS首先定位与细粒度修改相关的角色控制参数,然后在低维空间中优化相应参数,以避免不切实际的结果。大量的实验结果表明,我们提出的ICE在游戏内角色创建方面的有效性以及ICE优越的编辑性能。
英文摘要:
ost recent popular Role-Playing Games (RPGs) allow players to create in-game characters with hundreds of adjustable parameters, including bone positions and various makeup options. Although text-driven auto-customization systems have been developed to simplify the complex process of adjusting these intricate character parameters, they are limited by their single-round generation and lack the capability for further editing and fine-tuning. In this paper, we propose an Interactive Character Editing framework (ICE) to achieve a multi-round dialogue-based refinement process. In a nutshell, our ICE offers a more user-friendly way to enable players to convey creative ideas iteratively while ensuring that created characters align with the expectations of players. Specifically, we propose an Instruction Parsing Module (IPM) that utilizes large language models (LLMs) to parse multi-round dialogues into clear editing instruction prompts in each round. To reliably and swiftly modify character control parameters at a fine-grained level, we propose a Semantic-guided Low-dimension Parameter Solver (SLPS) that edits character control parameters according to prompts in a zero-shot manner. Our SLPS first localizes the character control parameters related to the fine-grained modification, and then optimizes the corresponding parameters in a low-dimension space to avoid unrealistic results. Extensive experimental results demonstrate the effectiveness of our proposed ICE for in-game character creation and the superior editing performance of ICE.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。