用于从触觉信号中估计3D姿态、动作分类和运动进度预测的共享表示
Shared Representation for 3D Pose Estimation, Action Classification, and Progress Prediction from Tactile Signals
AI总结:
本文提出SCOTTI模型,通过共享表示同时处理3D姿态估计、动作分类和运动进度预测,利用多任务学习提升性能,实验表明其在三项任务中均优于独立学习方法。
摘要:
估计人类姿态、分类动作和预测运动进度对于人机交互至关重要。虽然基于视觉的方法在真实环境中面临遮挡和隐私问题,但触觉传感可以避免这些问题。然而,以往的触觉方法各自处理任务,导致性能不佳。本文提出共享卷积变换器(SCOTTI),学习共享表示以同时解决三个预测任务:3D人体姿态估计、动作分类和动作完成进度估计。本文首次利用自定义无线足垫传感器的足部触觉信号进行动作进度预测。该统一方法利用多任务学习的优势,使模型在所有三个任务中均优于独立学习。实验结果表明,SCOTTI在所有三个任务中均优于现有方法。此外,我们引入了一个新的数据集,包含15名参与者进行各种活动和练习的7小时数据,涵盖八种不同活动。
英文摘要:
Estimating human pose, classifying actions, and predicting movement progress are essential for human-robot interaction. While vision-based methods suffer from occlusion and privacy concerns in realistic environments, tactile sensing avoids these issues. However, prior tactile-based approaches handle each task separately, leading to suboptimal performance. In this study, we propose a Shared COnvolutional Transformer for Tactile Inference (SCOTTI) that learns a shared representation to simultaneously address three separate prediction tasks: 3D human pose estimation, action class categorization, and action completion progress estimation. To the best of our knowledge, this is the first work to explore action progress prediction using foot tactile signals from custom wireless insole sensors. This unified approach leverages the mutual benefits of multi-task learning, enabling the model to achieve improved performance across all three tasks compared to learning them independently. Experimental results demonstrate that SCOTTI outperforms existing approaches across all three tasks. Additionally, we introduce a novel dataset collected from 15 participants performing various activities and exercises, with 7 hours of total duration, across eight different activities.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。