arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.02737cs.CVcs.RO
收藏

用于时间一致的人类行走估计的Koopman姿态预测

Koopman pose predictions for temporally consistent human walking estimations

Brigham and Women’s Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);Boston University(波士顿大学)

Marc Mitjans, David M. Levine, Louis N. Awad, Roberto Tron

摘要:

我们解决了跟踪人体下半身的问题,作为自动运动评估系统用于临床移动性评估的第一步,使用多模式系统,结合惯性测量单元(IMU)数据,RGB图像和点云深度测量。该系统将因子图表示应用于提供3-D骨架关节估计的优化问题。在本文中,我们专注于提高估计的人类轨迹的时间一致性,大大扩展深度传感器的可操作性范围。更具体地说,我们引入了一个新的因子图因子Koopman理论的基础上,嵌入了几个下肢运动活动的非线性动力学。该因子执行两步过程:首先,基于时空图卷积网络的自定义活动识别模块识别行走活动;然后,将后续骨架的Koopman姿势预测用作先验估计,以将优化问题推向更一致的结果。我们在由多个临床下肢移动性测试组成的数据集上测试了该模块的性能,结果表明,我们的方法将骨骼形式上的离群值减少了近1米,同时在深度超过10米的情况下保留了自然的行走轨迹。

英文摘要:

We tackle the problem of tracking the human lower body as an initial step toward an automatic motion assessment system for clinical mobility evaluation, using a multimodal system that combines Inertial Measurement Unit (IMU) data, RGB images, and point cloud depth measurements. This system applies the factor graph representation to an optimization problem that provides 3-D skeleton joint estimations. In this paper, we focus on improving the temporal consistency of the estimated human trajectories to greatly extend the range of operability of the depth sensor. More specifically, we introduce a new factor graph factor based on Koopman theory that embeds the nonlinear dynamics of several lower-limb movement activities. This factor performs a two-step process: first, a custom activity recognition module based on spatial temporal graph convolutional networks recognizes the walking activity; then, a Koopman pose prediction of the subsequent skeleton is used as an a priori estimation to drive the optimization problem toward more consistent results. We tested the performance of this module on datasets composed of multiple clinical lowerlimb mobility tests, and we show that our approach reduces outliers on the skeleton form by almost 1 m, while preserving natural walking trajectories at depths up to more than 10 m.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑