arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

跨模态引导用于模拟假体视觉中的视野外物体搜索

Cross-Modal Guidance for Out-of-View Object Search in Simulated Prosthetic Vision

Adyah Rastogi, Apurv Varshney, Tobias Höllerer, Michael Beyeler

arXiv 2609.01438首次发表:更新:

发表机构

University of California, Santa Barbara(加州大学圣塔芭芭拉分校)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

该研究在模拟假体视觉下测试跨模态引导对视野外物体搜索的影响,发现听觉和触觉引导比视觉引导更高效,且10x10电极密度条件下定位误差降低更显著。

AI 中文摘要

视野外引导在虚拟现实和增强现实中已得到广泛应用,但其有效性可能取决于用户可用的视觉带宽。我们在模拟假体视觉(SPV)下对此进行测试,其中视觉引导必须与用于场景检查的稀疏表示共享。19名参与者在两种SPV条件下执行物体搜索,这两种条件的电极密度和磷光扩散不同(10x10和20x20),以及四种引导条件(无引导、视觉、触觉、听觉),均由相同的水平目标偏移变量驱动。所有三种模态均减少了搜索时间和头部运动。测试的听觉和触觉提示使整体搜索速度提高了约25%,目标获取速度比视觉提示快11-13%,尽管定向轨迹同样直接。测试的触觉和听觉提示还缩短了获取后的搜索时间。在10x10 SPV条件下,最终头部-目标角度偏移的减少幅度更大;在该条件下,所有三种提示还将垂直定位误差降低了约45-58%,尽管它们未提供高程信息。在严格的视觉约束下,引导性能取决于提示的实现方式和搜索阶段。

英文摘要

Out-of-view guidance is well established in virtual and augmented reality, but its effectiveness may depend on the visual bandwidth available to the user. We test this under simulated prosthetic vision (SPV), where visual guidance must share the same sparse representation used to inspect the scene. Nineteen participants performed object search under two SPV conditions differing in electrode density and phosphene spread (10x10 and 20x20) and four guidance conditions (no guidance, visual, haptic, audio) all driven by the same horizontal target-offset variable. All three modalities reduced search time and head movement. The tested auditory and haptic cues produced approximately 25% faster overall search and 11-13% faster target acquisition than the visual cue, despite similarly direct orienting trajectories. The tested haptic and auditory cues also shortened post-acquisition search. Final head-target angular offset was reduced substantially more in the 10x10 SPV condition; there, all three cues also reduced vertical localization error by approximately 45-58% despite providing no elevation information. Under severe visual constraints, guidance performance depended on cue implementation and search stage.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑