arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.07655cs.RO
收藏

基于可穿戴传感器的同时动作识别及人体全身运动和动力学预测

Simultaneous Action Recognition and Human Whole-Body Motion and Dynamics Prediction from Wearable Sensors

Istituto Italiano di Tecnologia(意大利技术研究院);Inria(法国国家信息与自动化研究所);Université de Lorraine(洛林大学);CNRS(法国国家科学研究中心)

Kourosh Darvish, Serena Ivaldi, Daniele Pucci

摘要:

本文提出了一种新的方法,同时解决人体活动识别和全身运动和动力学预测的实时应用的问题。从人体运动的动力学和运动系统理论出发,来自深度学习的混合专家模型的概念已经扩展到解决这个问题。在所提出的方法中,专家被建模为序列到序列的递归神经网络(RNN)架构。实验结果表明,66自由度的真实世界中的人体运动预测和动作识别在不同的任务,如步行和旋转。与本文相关的代码可从以下网址获得:\url{github.com/ami-iit/paper_darvish_2022_humanoids_action-kindyn-predicition}

英文摘要:

This paper presents a novel approach to solve simultaneously the problems of human activity recognition and whole-body motion and dynamics prediction for real-time applications. Starting from the dynamics of human motion and motor system theory, the notion of mixture of experts from deep learning has been extended to address this problem. In the proposed approach, experts are modelled as a sequence-to-sequence recurrent neural networks (RNN) architecture. Experiments show the results of 66-DoF real-world human motion prediction and action recognition during different tasks like walking and rotating. The code associated with this paper is available at: \url{github.com/ami-iit/paper_darvish_2022_humanoids_action-kindyn-predicition}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑