arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.09607cs.CV
收藏

用于假肢视觉的语义与结构图像分割

Semantic and structural image segmentation for prosthetic vision

Instituto de Investigación en Ingeniería de Aragón (I3A)(阿拉贡工程研究所);Universidad de Zaragoza(萨拉戈萨大学);Centro Universitario de la Defensa(国防大学中心)

Melani Sanchez-Garcia, Ruben Martinez-Cantin, Jose J. Guerrero

AI总结:

提出一种结合多种卷积神经网络提取室内环境结构边缘与物体轮廓的方法,构建光幻视图像示意图表示,在模拟假肢视觉系统中显著提升了物体与房间识别准确率。

摘要:

假肢视觉正被应用于部分恢复视障人士的视网膜刺激。然而,由于分辨率低且缺乏颜色或对比度,植入物产生的光幻视图像的信息带宽非常有限。假肢使用者在真实环境中进行物体识别和场景理解的能力受到严重限制。计算机视觉可以在克服这些局限性和优化模拟假肢视觉中的视觉信息方面发挥关键作用,从而增加所呈现的信息量。我们提出了一种新方法,为光幻视图像构建室内环境的示意图表示。该方法结合了多种卷积神经网络,用于提取和传递关于场景的相关信息,如环境的结构信息边缘和分割物体的轮廓。实验在正常视力受试者中使用模拟假肢视觉系统进行。结果表明,与其他图像处理方法相比,所提出的方法在室内场景的物体识别和房间识别任务中表现出良好的准确率。

英文摘要:

Prosthetic vision is being applied to partially recover the retinal stimulation of visually impaired people. However, the phosphenic images produced by the implants have very limited information bandwidth due to the poor resolution and lack of color or contrast. The ability of object recognition and scene understanding in real environments is severely restricted for prosthetic users. Computer vision can play a key role to overcome the limitations and to optimize the visual information in the simulated prosthetic vision, improving the amount of information that is presented. We present a new approach to build a schematic representation of indoor environments for phosphene images. The proposed method combines a variety of convolutional neural networks for extracting and conveying relevant information about the scene such as structural informative edges of the environment and silhouettes of segmented objects. Experiments were conducted with normal sighted subjects with a Simulated Prosthetic Vision system. The results show good accuracy for object recognition and room identification tasks for indoor scenes using the proposed approach, compared to other image processing methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑