arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.08088cs.CV

基于坐标双约束的自回归运动生成

Coordinate-Based Dual-Constrained Autoregressive Motion Generation

School of Cyber Science and Engineering, Southeast University(东南大学网络空间安全学院);School of Computer Science and Engineering, Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications, Ministry of Education, Southeast University(东南大学计算机科学与工程学院、教育部新一代人工智能技术及其跨学科应用重点实验室);Purple Mountain Laboratories(紫金山实验室);Engineering Research Center of Blockchain Application, Supervision And Management (Southeast University), Ministry of Education(教育部区块链应用监管工程研究中心(东南大学));State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所多模态人工智能系统全国重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)

Kang Ding, Hongsong Wang, Jie Gui, Liang Wang

AI总结:

本文提出CDAMD框架,通过坐标输入和双约束因果掩码提升文本到运动的生成质量与语义一致性。

摘要:

文本到运动生成近期在研究社区中受到越来越多关注,潜在应用于动画、虚拟现实、机器人和人机交互。扩散模型和自回归模型是文本到运动生成的两个流行研究方向。然而,扩散模型在噪声预测中常出现误差放大,而自回归模型由于运动离散化导致模式崩溃。为解决这些限制,我们提出了一种灵活、高保真且语义忠实的文本到运动框架,称为基于坐标的双约束自回归运动生成(CDAMD)。以运动坐标作为输入,CDAMD遵循自回归范式,并利用受扩散启发的多层感知机来增强预测运动的保真度。此外,引入了双约束因果掩码以指导自回归生成,其中运动标记作为先验并与其文本编码拼接。由于坐标基运动合成的研究有限,我们建立了文本到运动生成和运动编辑的新基准。实验结果表明,我们的方法在这些基准上实现了最先进的保真度和语义一致性。

英文摘要:

Text-to-motion generation has attracted increasing attention in the research community recently, with potential applications in animation, virtual reality, robotics, and human-computer interaction. Diffusion and autoregressive models are two popular and parallel research directions for text-to-motion generation. However, diffusion models often suffer from error amplification during noise prediction, while autoregressive models exhibit mode collapse due to motion discretization. To address these limitations, we propose a flexible, high-fidelity, and semantically faithful text-to-motion framework, named Coordinate-based Dual-constrained Autoregressive Motion Generation (CDAMD). With motion coordinates as input, CDAMD follows the autoregressive paradigm and leverages diffusion-inspired multi-layer perceptrons to enhance the fidelity of predicted motions. Furthermore, a Dual-Constrained Causal Mask is introduced to guide autoregressive generation, where motion tokens act as priors and are concatenated with textual encodings. Since there is limited work on coordinate-based motion synthesis, we establish new benchmarks for both text-to-motion generation and motion editing. Experimental results demonstrate that our approach achieves state-of-the-art performance in terms of both fidelity and semantic consistency on these benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑