arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.07697cs.CV

学习上下文自适应的运动先验以实现遮蔽运动扩散模型的高效运动学注意力聚合

Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregation

Department of Computer Science, Hong Kong Baptist University(计算机科学系,香港 Baptist 大学)

Junkun Jiang, Jie Chen, Ho Yin Au, Jingyu Xiang

AI总结:

MMDM通过高效运动学注意力聚合机制,学习上下文自适应的运动先验,实现遮蔽运动数据的高效重建与生成。

摘要:

基于视觉的运动捕捉解决方案经常在遮挡情况下遇到困难,导致关键关节信息丢失,从而阻碍准确的3D运动重建。其他可穿戴替代方案也面临噪声或不稳定数据的问题,通常需要大量的手动清洁和修正才能获得可靠的结果。为了解决这些挑战,我们引入了遮蔽运动扩散模型(MMDM),一种基于扩散的生成重建框架,它利用部分可用的高质量重建数据,在遮蔽自动编码器架构中增强不完整或低置信度的运动数据。我们设计的核心是运动学注意力聚合(KAA)机制,它使架构能够高效、深入和迭代地编码关节级和姿态级特征,捕捉对任务特定重建至关重要的结构和时间运动模式。我们专注于学习上下文自适应的运动先验,这些先验是通过相同可重用的架构提取的专用结构和时间特征,其中每个学习的先验强调运动动态的不同方面,并且专门针对其对应的任务进行高效处理。这使架构能够适应性地专业化而不改变其结构。这种多功能性使MMDM能够高效地学习适用于运动细化、补全和中间帧的运动先验。在公共基准上的广泛评估表明,MMDM在各种遮蔽策略和任务设置中均实现了强大的性能。源代码可在https://github.com/jjkislele/MMDM上获取。

英文摘要:

Vision-based motion capture solutions often struggle with occlusions, which result in the loss of critical joint information and hinder accurate 3D motion reconstruction. Other wearable alternatives also suffer from noisy or unstable data, often requiring extensive manual cleaning and correction to achieve reliable results. To address these challenges, we introduce the Masked Motion Diffusion Model (MMDM), a diffusion-based generative reconstruction framework that enhances incomplete or low-confidence motion data using partially available high-quality reconstructions within a Masked Autoencoder architecture. Central to our design is the Kinematic Attention Aggregation (KAA) mechanism, which enables efficient, deep, and iterative encoding of both joint-level and pose-level features, capturing structural and temporal motion patterns essential for task-specific reconstruction. We focus on learning context-adaptive motion priors, specialized structural and temporal features extracted by the same reusable architecture, where each learned prior emphasizes different aspects of motion dynamics and is specifically efficient for its corresponding task. This enables the architecture to adaptively specialize without altering its structure. Such versatility allows MMDM to efficiently learn motion priors tailored to scenarios such as motion refinement, completion, and in-betweening. Extensive evaluations on public benchmarks demonstrate that MMDM achieves strong performance across diverse masking strategies and task settings. The source code is available at https://github.com/jjkislele/MMDM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑