arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.23747cs.HC
收藏

感受,而非感受:手部追踪XR中的情感音频视觉伪触觉

Feelings, Not Feel: Affective Audio-Visual Pseudo-Haptics in Hand-Tracked XR

University of the Philippines Los Baños(菲律宾大学洛斯巴尼奥斯分校);De La Salle University(德拉萨大学)

Kristian Paolo David, Tyrone Justin Sta Maria, Mikkel Dominic Gamboa, Jordan Aiko Deja

AI总结:

该研究探讨了在无控制器的XR环境中,通过伪触觉线索(音频、视觉)影响用户情感体验的机制,发现其更应视为情感反馈而非直接触觉替代。

摘要:

手部追踪使控制器-free的XR交互成为可能,但并不具备触觉反馈控制器所提供的触觉反馈。而非将此单纯视为缺失感觉的问题,我们探讨伪触觉线索在具身虚拟手上的作用是否作为触觉或情感替代品,影响交互的感受。我们使用了一个混合现实原型,使接触的表面在视觉上保持中性,通过手部的运动调制来呈现纹理、颜色发光和与运动耦合的声音线索。在一项内组研究(n=12)中,参与者经历了12种条件(4种效果x3种模态:音频、视觉、两者),并报告了主观情感和认知需求。参与者很少报告持续的触觉和热感,但情感却系统性地发生变化:粗糙-热降低了效价并增加唤醒,而光滑-冷则产生更平静愉快的状态。这些发现表明,在控制器-free系统中,XR中的伪触觉可能应被理解为一种情感反馈通道,而非直接替代物理触觉。

英文摘要:

Hand-tracking enables controller-free XR interaction but does not have the tactile feedback controllers provide. Rather than treating this solely as a missing-sensation problem, we explore whether pseudo-haptic cues on an embodied virtual hand act as tactile or as affect substitutes that shape how interactions feel. We used a mixed reality prototype that keeps the contacted surface visually neutral, rendering cues on the hand with motion modulation for texture, color glow, and movement-coupled sound. In a within-subjects study (n=12), participants experienced 12 conditions (4 effects x 3 modalities: audio, visual, both) and reported subjective affect and cognitive demand. Participants rarely reported sustained tactile, thermal sensations, yet affect shifted systematically: rough-hot lowered valence increasing arousal, while smooth-cold produced calmer pleasant states. These findings suggest that pseudo-haptics in XR may be better understood as an affective feedback channel rather than a direct replacement for physical touch in controller-free systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑