arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.12652cs.CVcs.GRcs.HCcs.RO
收藏

UltraGlove:基于MEMS-超声波传感器的手部姿态估计

UltraGlove: Hand Pose Estimation with Mems-Ultrasonic Sensors

Princeton University(普林斯顿大学)

Qiang Zhang, Yuanqiao Lin, Yubin Lin, Szymon Rusinkiewicz

AI总结:

本文提出了一种基于MEMS-超声波传感器的低成本手部追踪手套,通过测量传感器间距离矩阵并用轻量级深度网络重建手部姿态,有效解决了视觉遮挡和IMU漂移问题。

摘要:

手部追踪是人机交互的重要方面,在扩展现实设备中有广泛应用。然而,当前的手部动作捕捉方法存在各种局限性。例如,基于视觉的手部姿态估计易受自遮挡和光照条件变化的影响,而基于IMU的追踪手套会产生显著漂移,且易受外部磁场干扰。为解决这些问题,我们提出了一种新型低成本手部追踪手套,利用附着在手指上的多个MEMS-超声波传感器来测量传感器间的距离矩阵。随后,我们的轻量级深度网络从距离矩阵中重建手部姿态。实验结果表明,该方法准确、与尺寸无关,且对外部干扰具有鲁棒性。我们还展示了传感器选择、传感器配置、电路图以及模型架构的设计逻辑。

英文摘要:

Hand tracking is an important aspect of human-computer interaction and has a wide range of applications in extended reality devices. However, current hand motion capture methods suffer from various limitations. For instance, visual-based hand pose estimation is susceptible to self-occlusion and changes in lighting conditions, while IMU-based tracking gloves experience significant drift and are not resistant to external magnetic field interference. To address these issues, we propose a novel and low-cost hand-tracking glove that utilizes several MEMS-ultrasonic sensors attached to the fingers, to measure the distance matrix among the sensors. Our lightweight deep network then reconstructs the hand pose from the distance matrix. Our experimental results demonstrate that this approach is both accurate, size-agnostic, and robust to external interference. We also show the design logic for the sensor selection, sensor configurations, circuit diagram, as well as model architecture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑