arXiv 1811.103992018-11-26cs.CVcs.LG

A Convolutional Neural Network based Live Object Recognition System as Blind Aid

New York University（纽约大学）；WIEECT

Kedar Potdar, Chinmay D. Pai, Sukrut Akolkar

英文摘要：

This paper introduces a live object recognition system that serves as a blind aid. Visually impaired people heavily rely on their other senses such as touch and auditory signals for understanding the environment around them. The act of knowing what object is in front of the blind person without touching it (by hand or some other tool) is very difficult. In some cases, the physical contact between the person and object can be dangerous, and even lethal. This project employs a Convolutional Neural Network for recognition of pre-trained objects on the ImageNet dataset. A camera, aligned with the system's predetermined orientation serves as input to the computer system, which has the object recognition Neural Network deployed to carry out real-time object detection. Output from the network can then be parsed to present to the visually impaired person either in the form of audio or Braille text.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Advanced Audio Aid for Blind People

Quaid-e-Awam University of Engineering, Science and Technology（奎德阿瓦姆工程科学技术大学）；Mehran University of Engineering and Technology（梅赫兰工程技术大学）

One of the most important senses in human life is vision, without it life is totally filled with darkness. According to WHO globally millions of people are visually impaired estimated there are 285 million, of whom some millions are blind. Unfortunately, there are around 2.4 million people are blind in our beloved country Pakistan. Human are a crucial part of society and the blind community is a main part of society. The technologies are grown so far to make the life of humans easier more comfortable and more reliable for. However, this disability of the blind community would reduce their chan…

2022-11-17cs.CVcs.HCcs.SD

Help the Blind See: Assistance for the Visually Impaired through Augmented Acoustic Simulation

Theia Project（忒弥斯项目）

An estimated 253 million people have visual impairments. These visual impairments affect everyday lives, and limit their understanding of the outside world. This can pose a risk to health from falling or collisions. We propose a solution to this through quick and detailed communication of environmental spatial geometry through sound, providing the blind and visually impaired the ability to understand their spatial environment through sound technology. The model consists of fast object detection and 3D environmental mapping, which is communicated through a series of quick sound notes. These sou…

2023-02-09cs.CVcs.HCcs.SD

使用带有语音反馈的目标检测来辅助盲人

Assisting Blind People Using Object Detection with Vocal Feedback

University of Benghazi（班加西大学）

针对视障人士难以安全移动和感知环境风险物体的问题，提出基于 YOLO 模型与 OpenCV 的实时目标检测方法，并通过 Google text-to-speech 库以语音反馈物体位置，实验表明其 mAP 表现优于以往方法。

2023-12-18cs.CV

基于学习扫视路径的盲全景视频质量评估

Learned Scanpaths Aid Blind Panoramic Video Quality Assessment

City University of Hong Kong（香港城市大学）；Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））；The University of Hong Kong（香港大学）

针对全景视频球面特性导致的观看行为不确定、质量评估难的问题，提出含扫视路径生成器与质量评估器的端到端盲PVQA方法，经多数据集验证性能优于现有方法，还可评估全景图像质量。

2024-05-15cs.CVeess.IV

Position and Vector Detection of Blind Spot motion with the Horn-Schunck Optical Flow

Torrey Pines High School（托里派恩斯高中）；University of Nevada, Las Vegas（内华达大学拉斯维加斯分校）；University of California, San Diego（加利福尼亚大学圣迭戈分校）

The proposed method uses live image footage which, based on calculations of pixel motion, decides whether or not an object is in the blind-spot. If found, the driver is notified by a sensory light or noise built into the vehicle's CPU. The new technology incorporates optical vectors and flow fields rather than expensive radar-waves, creating cheaper detection systems that retain the needed accuracy while adapting to the current processor speeds.

2016-03-24cs.CV

A Multi-task convolutional neural network for blind stereoscopic image quality assessment using naturalness analysis

Mohammed V University in Rabat（拉巴特穆罕默德五世大学）

This paper addresses the problem of blind stereoscopic image quality assessment (NR-SIQA) using a new multi-task deep learning based-method. In the field of stereoscopic vision, the information is fairly distributed between the left and right views as well as the binocular phenomenon. In this work, we propose to integrate these characteristics to estimate the quality of stereoscopic images without reference through a convolutional neural network. Our method is based on two main tasks: the first task predicts naturalness analysis based features adapted to stereo images, while the second task pr…

2021-06-21cs.CVeess.IV

更多相关论文收起更多论文

通过多模态感知与步态引导实现盲人导航

Implementing blind navigation through multi-modal sensing and gait guidance

China University of Mining and Technology - Beijing（中国矿业大学（北京））

针对视障人群寻路避障困难及传统辅助工具的不足，本文提出一种可穿戴盲人引导设备，创新性地结合步态相位分析与多模态感知技术，室内外实验证明其导航性能优于标准导盲杖。

2025-06-24cs.CVcs.SYeess.SY

利用机器学习与计算机视觉改善低视力及盲人群体的无障碍体验

Improve accessibility for Low Vision and Blind people using Machine Learning and Computer Vision

本项目提出构建一款结合机器学习与计算机视觉的移动应用，通过文本朗读、物体检测与触觉反馈以及货币识别三项功能，为盲人和低视力人群提供实时空间定向与无障碍辅助。

2024-03-24cs.CVcs.HCcs.LG

识别盲人和低视力个体导航中的关键物体

Identifying Crucial Objects in Blind and Low-Vision Individuals' Navigation

Pennsylvania State University（宾夕法尼亚州立大学）；Drake University（德雷克大学）

本文提出了一个包含90个对盲人和低视力个体导航至关重要的物体列表，涵盖道路、人行道和室内环境。研究通过分析21个视频并经焦点小组反馈完善该列表，发现现有计算机视觉数据集仅涵盖其中少部分物体，并为31个视频片段提供详细标注，公开相关资源以促进开发更包容有效的导航辅助工具。

2024-08-23cs.CV

为盲人和低视力者导航至关重要的物体识别数据集

A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation

Pennsylvania State University（宾夕法尼亚州立大学）；Drake University（德拉克大学）

本文提出一个专为盲人和低视力者导航设计的数据集，包含90个关键物体的标注，旨在提升计算机视觉模型在实时物体识别中的准确性。

2026-03-01cs.CVcs.HC

EgoBlind：面向盲人的以自我为中心的视觉辅助

EgoBlind: Towards Egocentric Visual Assistance for the Blind

National University of Singapore（新加坡国立大学）；Communication University of China（中国传媒大学）；University of Science and Technology of China（中国科学技术大学）；Hefei University of Technoloy（合肥工业大学）

本文提出首个从盲人收集的以自我为中心的VideoQA数据集EgoBlind，包含1,392个视频和5,311个问题，评估16个先进MLLMs发现其准确率远低于人类，并总结现有局限性及启发式改进方案，为开发有效AI视觉辅助奠定基础。

2025-11-03cs.AIcs.CVcs.MM

Blind microscopy image denoising with a deep residual and multiscale encoder/decoder network

Universidad Tecnológica de Pereira（佩雷拉理工大学）

In computer-aided diagnosis (CAD) focused on microscopy, denoising improves the quality of image analysis. In general, the accuracy of this process may depend both on the experience of the microscopist and on the equipment sensitivity and specificity. A medical image could be corrupted by both intrinsic noise, due to the device limitations, and, by extrinsic signal perturbations during image acquisition. Nowadays, CAD deep learning applications pre-process images with image denoising models to reinforce learning and prediction. In this work, an innovative and lightweight deep multiscale convol…

2021-05-01cs.CVeess.IV

A Comparison of Deep Learning Convolution Neural Networks for Liver Segmentation in Radial Turbo Spin Echo Images

University of Arizona（亚利桑那大学）

Motion-robust 2D Radial Turbo Spin Echo (RADTSE) pulse sequence can provide a high-resolution composite image, T2-weighted images at multiple echo times (TEs), and a quantitative T2 map, all from a single k-space acquisition. In this work, we use a deep-learning convolutional neural network (CNN) for the segmentation of liver in abdominal RADTSE images. A modified UNET architecture with generalized dice loss objective function was implemented. Three 2D CNNs were trained, one for each image type obtained from the RADTSE sequence. On evaluating the performance of the CNNs on the validation set, …

2020-04-13cs.CVcs.LGeess.IV

通过时空图卷积网络迁移学习的视障人士剧场辅助系统

Theater Aid System for the Visually Impaired Through Transfer Learning of Spatio-Temporal Graph Convolution Networks

USTHB University（USTHB大学）

本研究构建了基于骨骼数据的剧场人类动作识别系统以辅助视障人士，通过在NTU-RGBD基准与自建剧场数据集间应用三种时空图卷积网络的迁移学习，提出两种配置适应域差异，显著提升了剧场动作识别性能。

2023-06-28cs.CV

Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields

Technische Universität München（慕尼黑工业大学）；LMU Hospital Grosshadern（LMU格罗斯哈德恩医院）

Automatic segmentation of the liver and its lesion is an important step towards deriving quantitative biomarkers for accurate clinical diagnosis and computer-aided decision support systems. This paper presents a method to automatically segment liver and lesions in CT abdomen images using cascaded fully convolutional neural networks (CFCNs) and dense 3D conditional random fields (CRFs). We train and cascade two FCNs for a combined segmentation of the liver and its lesions. In the first step, we train a FCN to segment the liver as ROI input for a second FCN. The second FCN solely segments lesion…

2016-10-07cs.CV

Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks

Technical University of Munich（慕尼黑工业大学）；LMU Hospital Grosshadern（路德维希-马克西米利安-慕尼黑大学格罗斯哈德恩医院）

Automatic segmentation of the liver and hepatic lesions is an important step towards deriving quantitative biomarkers for accurate clinical diagnosis and computer-aided decision support systems. This paper presents a method to automatically segment liver and lesions in CT and MRI abdomen images using cascaded fully convolutional neural networks (CFCNs) enabling the segmentation of a large-scale medical trial or quantitative image analysis. We train and cascade two FCNs for a combined segmentation of the liver and its lesions. In the first step, we train a FCN to segment the liver as ROI input …

2017-02-23cs.AIcs.CV

空间记忆必须存储什么：遮挡作为语言-智能体记忆的测试

What Spatial Memory Must Store: Occlusion as the Test for Language-Agent Memory

Space Zero, Inc.（Space Zero公司）

本文通过实验证明，在空间查询场景中，几何信息必须主导记忆召回，而可见性判断需要独立于记忆召回，并提出了基于射线-体素DDA的可见性谓词计算方法。

2026-06-09cs.AIcs.CVcs.MA