交互式3D地图用于远程视觉辅助的可行性
Feasibility of Interactive 3D Map for Remote Sighted Assistance
摘要:
远程视觉辅助(RSA)已经作为会话辅助技术出现,其中远程视觉工作者,即,代理,通过类似视频聊天的通信为视力障碍用户提供实时帮助。研究人员发现,智能体缺乏环境知识,难以在周围环境中为用户定位,以及无法估计与用户摄像头的距离,这些都是有视力智能体面临的关键挑战。为了应对这些挑战,研究人员建议用计算机视觉技术,特别是3D重建来帮助代理。本文提出了一个高保真原型,这样的RSA,代理使用交互式三维地图与本地化能力。我们进行了一个演练研究,十三代理和一个用户模拟视力障碍使用这个原型。研究表明,与基线RSA相比,智能体在为用户提供导航帮助方面明显更快,并且他们的心理工作量显着减少-所有这些都表明了RSA中3D地图的可行性和前景。
英文摘要:
Remote sighted assistance (RSA) has emerged as a conversational assistive technology, where remote sighted workers, i.e., agents, provide real-time assistance to users with vision impairments via video-chat-like communication. Researchers found that agents' lack of environmental knowledge, the difficulty of orienting users in their surroundings, and the inability to estimate distances from users' camera feeds are key challenges to sighted agents. To address these challenges, researchers have suggested assisting agents with computer vision technologies, especially 3D reconstruction. This paper presents a high-fidelity prototype of such an RSA, where agents use interactive 3D maps with localization capability. We conducted a walkthrough study with thirteen agents and one user with simulated vision impairment using this prototype. The study revealed that, compared to baseline RSA, the agents were significantly faster in providing navigational assistance to users, and their mental workload was significantly reduced -- all indicate the feasibility and prospect of 3D maps in RSA.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。