面向鲁棒手部压力估计的姿态感知肌肉力学习
Posture-Informed Muscular Force Learning for Robust Hand Pressure Estimation
AI总结:
本研究提出PiMForce框架,结合3D手部姿态与前臂sEMG信号提升手部压力估计的准确性与鲁棒性,配套多模态采集系统和21人参与构建的综合数据集,弥补了传统单模态方法的不足。
摘要:
我们提出PiMForce这一新型框架,该框架通过利用3D手部姿态信息增强前臂表面肌电图(sEMG)信号,提升手部压力估计性能。我们的方法结合3D手部姿态的详细空间信息与sEMG采集的动态肌肉活动,可在多样的手-物交互场景下实现准确、鲁棒的全手压力测量。我们还开发了一套多模态数据采集系统,整合了压力手套、sEMG臂环和无标记手指追踪模块。我们通过该采集系统招募21名参与者,构建了一个综合数据集,采集了不同手部姿态和手-物交互场景下的手部姿态、sEMG信号与施加的手部压力的同步数据。我们的框架可在复杂自然的交互场景中实现精准的手部压力估计,通过整合3D手部姿态信息与sEMG信号,大幅缓解了传统基于sEMG或基于视觉的方法的局限性。视频演示、数据与代码已在线公开。
英文摘要:
We present PiMForce, a novel framework that enhances hand pressure estimation by leveraging 3D hand posture information to augment forearm surface electromyography (sEMG) signals. Our approach utilizes detailed spatial information from 3D hand poses in conjunction with dynamic muscle activity from sEMG to enable accurate and robust whole-hand pressure measurements under diverse hand-object interactions. We also developed a multimodal data collection system that combines a pressure glove, an sEMG armband, and a markerless finger-tracking module. We created a comprehensive dataset from 21 participants, capturing synchronized data of hand posture, sEMG signals, and exerted hand pressure across various hand postures and hand-object interaction scenarios using our collection system. Our framework enables precise hand pressure estimation in complex and natural interaction scenarios. Our approach substantially mitigates the limitations of traditional sEMG-based or vision-based methods by integrating 3D hand posture information with sEMG signals. Video demos, data, and code are available online.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。