MaskedMimic:通过掩码运动修复实现统一的基于物理的角色控制
MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpainting
AI总结:
提出MaskedMimic,将基于物理的角色控制统一表述为运动修复问题,通过单一模型利用部分运动描述合成连贯动画,支持多种控制模态并实现任务间无缝过渡。
摘要:
打造一个单一且通用的基于物理的控制器,使其能够在各种场景中为交互式角色注入生命,这是角色动画领域一个令人兴奋的前沿方向。理想的控制器应支持多种控制模态,如稀疏目标关键帧、文本指令和场景信息。尽管先前的工作提出了物理模拟且具备场景感知的控制模型,但这些系统主要致力于开发各自专精于少数任务和控制模态的控制器。本研究提出了 MaskedMimic,一种将基于物理的角色控制表述为通用运动修复问题的新方法。我们的核心见解是训练一个单一的统一模型,以从部分(掩码)运动描述中合成运动,这些描述包括掩码关键帧、物体、文本描述或其任意组合。这是通过利用运动跟踪数据并设计一种可扩展的训练方法来实现的,该方法能有效利用多样的运动描述来生成连贯的动画。通过这一过程,我们的方法学习到了一个基于物理的控制器,它提供了直观的控制界面,而无需为所有感兴趣的行为进行繁琐的奖励工程。由此产生的控制器支持广泛的控制模态,并能在截然不同的任务之间实现无缝过渡。通过运动修复统一角色控制,MaskedMimic 创造了通用的虚拟角色。这些角色能够动态适应复杂场景并按需组合多样的运动,从而实现更具交互性和沉浸感的体验。
英文摘要:
Crafting a single, versatile physics-based controller that can breathe life into interactive characters across a wide spectrum of scenarios represents an exciting frontier in character animation. An ideal controller should support diverse control modalities, such as sparse target keyframes, text instructions, and scene information. While previous works have proposed physically simulated, scene-aware control models, these systems have predominantly focused on developing controllers that each specializes in a narrow set of tasks and control modalities. This work presents MaskedMimic, a novel approach that formulates physics-based character control as a general motion inpainting problem. Our key insight is to train a single unified model to synthesize motions from partial (masked) motion descriptions, such as masked keyframes, objects, text descriptions, or any combination thereof. This is achieved by leveraging motion tracking data and designing a scalable training method that can effectively utilize diverse motion descriptions to produce coherent animations. Through this process, our approach learns a physics-based controller that provides an intuitive control interface without requiring tedious reward engineering for all behaviors of interest. The resulting controller supports a wide range of control modalities and enables seamless transitions between disparate tasks. By unifying character control through motion inpainting, MaskedMimic creates versatile virtual characters. These characters can dynamically adapt to complex scenes and compose diverse motions on demand, enabling more interactive and immersive experiences.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。