arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.12037cs.HCcs.CVcs.SYeess.SY

多模态反馈用于手持工具引导:结合基于手腕的触觉反馈与增强现实

Multimodal Feedback for Handheld Tool Guidance: Combining Wrist-Based Haptics with Augmented Reality

Stanford University(斯坦福大学)

Yue Yang, Christoph Leuze, Brian Hargreaves, Bruce Daniel, Fred M Baik

AI总结:

本研究通过结合增强现实与触觉反馈,提升手术中手持工具的精确引导与操作效率。

摘要:

我们研究了振动触觉手腕反馈如何增强光学透视增强现实(AR)中手持工具运动的空间引导。虽然AR叠加物被广泛用于支持外科任务,但视觉遮挡、光照条件和界面模糊可能会损害精度和信心。为了解决这些挑战,我们设计了一个结合AR视觉与定制手腕佩戴触觉设备的多模态系统,该设备提供方向性和状态反馈提示。一项与经验外科医生和住院医师进行的形成性研究确定了关键工具操作和参考映射的偏好,指导了我们的提示设计。在提示识别实验(N=21)中,参与者在视觉负荷下准确识别了五种振动模式,对完整执行器状态的识别率高于空间方向提示。在指导任务(N=27)中,使用AR和触觉反馈的参与者在空间精度(5.8毫米)和可用性(SUS=88.1)方面显著优于仅使用单一模态的参与者,尽管任务时间有所增加。参与者报告说,触觉提示提供了令人放心的确认,并在对齐过程中减少了认知努力。我们的结果强调了将基于手腕的触觉反馈整合到AR系统中以实现高精度、视觉复杂任务(如手术引导)的潜力。我们讨论了支持自信、高效工具操作的多模态界面的设计影响。

英文摘要:

We investigate how vibrotactile wrist feedback can enhance spatial guidance for handheld tool movement in optical see-through augmented reality (AR). While AR overlays are widely used to support surgical tasks, visual occlusion, lighting conditions, and interface ambiguity can compromise precision and confidence. To address these challenges, we designed a multimodal system combining AR visuals with a custom wrist-worn haptic device delivering directional and state-based cues. A formative study with experienced surgeons and residents identified key tool maneuvers and preferences for reference mappings, guiding our cue design. In a cue identification experiment (N=21), participants accurately recognized five vibration patterns under visual load, with higher recognition for full-actuator states than spatial direction cues. In a guidance task (N=27), participants using both AR and haptics achieved significantly higher spatial precision (5.8 mm) and usability (SUS = 88.1) than those using either modality alone, despite having modest increases in task time. Participants reported that haptic cues provided reassuring confirmation and reduced cognitive effort during alignment. Our results highlight the promise of integrating wrist-based haptics into AR systems for high-precision, visually complex tasks such as surgical guidance. We discuss design implications for multimodal interfaces supporting confident, efficient tool manipulation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑