arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2611.06637cs.CVcs.AI
收藏

基于持续先验补偿的人体运动预测

Human Motion Prediction via Continual Prior Compensation

School of Computer Science, Sun Yat-sen University(中山大学计算机学院);Guangdong Province Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室);Key Laboratory of Machine Intelligence and Advanced Computing (Sun Yat-sen University), Ministry of Education(教育部机器智能与先进计算重点实验室(中山大学))

Jianwei Tang, Jian-Fang Hu, Tianming Liang, Xiaotong Lin, Jiangxin Sun, Wei-Shi Zheng, Jianhuang Lai

AI总结:

提出CPC与CPC++框架,将HMP任务划分为多子任务逐步训练,引入PCF/FGPCF缓解先验遗忘,在多数据集与骨干模型上验证了有效性与灵活性。

摘要:

人体运动预测(Human Motion Prediction, HMP)旨在根据观测到的过去运动序列预测不同时刻的未来人体姿态。现有方法主要将不同时刻的预测视为单一预测任务,同时学习不同时刻的预测,这会面临一个主要局限:短期预测(即“近未来”预测)的学习可能会受到长期(即“远未来”预测)运动预测的阻碍。在本文中,我们开发了一种名为持续先验补偿(Continual Prior Compensation, CPC)的新型时间持续学习框架,用于逐步训练HMP模型,其中我们将对应不同时刻的运动预测任务划分为多个子任务,并以多阶段方式训练模型。为缓解逐步训练中的先验信息遗忘,我们进一步引入可学习随机变量先验补偿因子(Prior Compensation Factor, PCF)来显式衡量先验知识损失。我们从理论上证明,通过最小化目标函数的合理上界,PCF可与模型参数高效共同学习。所提出的CPC被进一步增强以估计每个子任务的先验信息损失,最终开发出具有细粒度先验补偿因子(Fine-Grained Prior Compensation Factor, FGPCF)的新框架CPC++。我们的CPC和CPC++框架十分灵活,可轻松与不同HMP骨干模型集成,并适配各种数据集和应用。在三个HMP基准数据集上使用多个SOTA HMP骨干模型(PGBIG、siMLPe、MotionMixer和LTD)进行的大量实验,证明了我们框架的有效性和灵活性。

英文摘要:

Human Motion Prediction (HMP) aims to predict future human poses at different moments according to observed past motion sequences. Previous approaches mainly treated the prediction of different temporal moments as a single prediction task and learned the predictions of varied moments simultaneously, which would encounter a main limitation: the learning of short-term predictions (referring to ``near-future'' prediction) could be hindered by the predictions of long-term (referring to ``far-future'' prediction) motions. In this paper, we develop a novel temporal continual learning framework called Continual Prior Compensation (CPC) to progressively train HMP models, in which we divide the prediction task of motions corresponding to varied temporal moments into several subtasks and train the model in a multi-stage manner. To mitigate the prior information forgetting in the progressive training, we further introduce a learnable random variable Prior Compensation Factor (PCF) to explicitly measure the prior knowledge loss. We theoretically show that the PCF can be efficiently learned together with the model parameters by minimizing a reasonable upper bound of the objective function. The proposed CPC is further enhanced to estimate the prior information loss for each subtask and a new framework called Continual Prior Compensation++ (CPC++) with Fine-Grained Prior Compensation Factor (FGPCF) is finally developed. Our CPC and CPC++ frameworks are quite flexible and can be easily integrated with different HMP backbone models and adapted to various datasets and applications. Extensive experiments on three HMP benchmark datasets using multiple SOTA HMP backbones (PGBIG, siMLPe, MotionMixer, and LTD) demonstrate the effectiveness and flexibility of our frameworks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑