发表机构
Cairo University; New Giza University（开罗大学; 新吉萨大学）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
针对视觉假体用户户外导航困难，提出一个三阶段端到端智能导航框架，通过目标检测、优先级过滤和刺激参数编码生成幻视表征，经虚拟现实验证提升用户独立性。
AI 中文摘要
视觉假体为完全视网膜失明患者部分恢复功能性视力提供了一条有前景的方向。然而，现有系统在将复杂视觉场景翻译为有意义的感知方面面临重大挑战，原因是空间分辨率有限，导致场景理解困难。此外，现有解决方案未充分考虑用户需求和顾虑，这在用户期望与所开发解决方案之间造成了显著差距。为解决这些差距，我们对10名盲人受试者进行了访谈。这些访谈基本表明，这些人的主要关键挑战是户外导航。在本文中，我们为视觉假体用户提出了一种端到端的智能导航系统。我们的方法采用三阶段框架。首先，实现一个目标检测器，用于在行人环境中识别和定位导航任务感兴趣的点，同时生成对用户可用的最安全路径。其次，将检测到的目标抽象为适合低空间分辨率视觉的简单几何形状。根据多标准优先级评分函数对检测到的目标进行过滤。最后，将此信息编码为优化的刺激参数，输入视觉假体植入物，以生成增强的幻视表征，用于避障和路径规划。整个系统通过视力正常的参与者使用虚拟现实模拟户外导航进行验证。我们的智能导航系统在考虑视觉假体局限性的同时，提高了用户独立性。
英文摘要
Visual prosthetics provide a promising direction for partial restoration of functional vision for people with total retinal blindness. However, existing systems face significant challenges in translating complex visual scenes into meaningful perceptions due to limited spatial resolution, leading to difficulties in scene understanding. Furthermore, existing solutions don't adequately account for user requirements and concerns, and this creates a significant gap between user expectations and the developed solutions. To address these gaps, we conducted interviews with 10 blind human subjects. These interviews essentially indicated that the main key challenge for these people is outdoor navigation. In this paper, we present an end-to-end smart navigation system for visual prostheses users. Our approach employs a three-stage framework. First, an object detector is implemented to identify and localize points of interest for navigation tasks in pedestrian environments, and simultaneously generate the safest paths available to the users. Second, the detected objects are abstracted into simple geometric shapes suitable for low-spatial-resolution vision. The detected objects are filtered based on a multi-criteria priority scoring function. Finally, this information is encoded into optimized stimulation parameters, which are fed into the visual prosthesis implants to generate enhanced phosphene representations for obstacle avoidance and path planning. This whole system is validated with sighted participants using virtual reality to simulate outdoor navigation. Our smart navigation system improves user independence while taking into account the limitations of visual prosthetics.
