发表机构
KAIST UVR Lab; KAIST PMRC; KAIST HCI Tech Lab; KAIST KI-ITC ARRC(韩国科学技术院虚拟与增强现实实验室; 韩国科学技术院物理医学研究综合中心; 韩国科学技术院人机交互技术实验室; 韩国科学技术院韩国人工智能信息通信技术应用研究资源中心)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本研究在VR协作中,通过设计基于手部轮廓的抽象视觉粗糙度线索,外化物体触觉状态,减少了触觉与非触觉用户间的信息不对称,缩短了协作任务完成时间。
AI 中文摘要
在协作式VR中,触觉硬件的不对称访问会造成严重的信息缺口:触觉用户的触觉证据仅对自身可见,阻碍了联合决策所需的共同理解。尽管已有研究探索了虚拟环境中的跨模态感官线索,但对于不同协作方通过不同模态接收信息的不对称协作场景,这类线索应如何设计仍不明确。在本研究场景中,触觉用户通过指尖振动感知粗糙度,而非触觉用户仅依赖视觉。为减少这种不对称性,我们提出通过直观的手部轮廓视觉代理外化物体的触觉状态。具体而言,我们研究基于线条形状和运动的抽象视觉粗糙度线索是否能为触觉用户和非触觉用户编码三个离散的粗糙度级别。两项初步研究通过识别非触觉用户可视觉区分的线索,并验证其与触觉用户的视触觉对应关系,建立了共享视觉语义。在一项协作排序任务的主研究中,与无可视化基线相比,在双方手部显示该可视化显著缩短了完成时间。此外,非触觉用户(NU)侧的线索可见性与更高的信心和感知贡献相关。这些发现表明,以手部为锚点的抽象视觉线索提供了一种轻量的方式来外化物体触觉状态,在不损害社会存在感的情况下减少了信息不对称。
英文摘要
In collaborative VR, asymmetric access to haptic hardware creates a critical information gap: tactile evidence remains private to the haptic user, hindering the shared understanding needed for joint decision-making. While prior work has explored crossmodal sensory cues in virtual environments, it remains unclear how such cues should be designed for asymmetric collaboration, where collaborators receive information through different modalities. In our setting, the haptic user feels roughness through fingertip vibration, whereas the non-haptic user relies on vision alone. To reduce this asymmetry, we propose externalizing an object's tactile state through a glanceable hand-outline visual proxy. Specifically, we examine whether abstract visual roughness cues based on line shape and motion can encode three discrete roughness levels for both haptic and non-haptic users. Two preliminary studies establish a shared visual semantics by identifying visually distinguishable cues for non-haptic users and validating their visuo-haptic correspondence for haptic users. In a main study of a collaborative sorting task, showing this visualization on both users' hands significantly reduced completion time relative to a no-visualization baseline. Moreover, NU-side cue visibility was associated with higher confidence and perceived contribution for the non-haptic user. These findings show that hand-anchored abstract visual cues provide a lightweight means of externalizing object tactile state, reducing information asymmetry without compromising social presence.
Comments10 pages, 8 figures, 9 tables. Accepted for publication in TVCG Special Issue on the 2026 IEEE Symposium on Mixed and Augmented Reality (IEEE ISMAR)