VisionAssist：一款用于基于人工智能的视觉无障碍的开源智能手机助手
VisionAssist: An Open-Source Smartphone Assistant for AI-Based Visual Accessibility
浏览论文内容
中文总结 AI 辅助
针对视力低下者日常视觉信息解读难题，开源应用VisionAssist集成物体定位、图像描述、紧急呼叫与提醒等功能，支持语音交互，通过统一平台和开源模式鼓励社区贡献，加速无障碍技术发展。
中文摘要 AI 辅助
视力低下的人在执行需要解读视觉信息的日常任务时常常面临挑战。我们展示了VisionAssist，一个开源移动应用程序，旨在通过智能手机提供人工智能驱动的视觉辅助来提高独立性。该应用程序在单个界面中集成了三种互补功能。首先，它通过分析实时摄像头画面让用户定位特定物体。其次，它为拍摄的图像生成语音描述，使用户能识别视觉内容。第三，它与智能手机的联系人及日历集成以方便紧急呼叫并提供语音提醒。该应用支持通过语音命令免提交互，并使用文本转语音合成提供所有反馈，让视障用户完全可访问。通过将多种辅助服务整合到统一平台并作为开源软件发布，该解决方案旨在鼓励社区贡献并加速无障碍技术的发展。
英文摘要
People with low vision often face challenges in performing everyday tasks that require interpreting visual information. We present \textbf{VisionAssist}, an open-source mobile application designed to improve independence by providing AI-powered visual assistance through a smartphone. The application integrates three complementary functionalities within a single interface. First, it enables users to locate specific objects by analyzing the live camera feed. Second, it generates spoken descriptions of captured images, allowing users to identify visual content such as food labels, documents, and everyday objects. Third, it integrates with the smartphone's contacts and calendar to facilitate emergency calls and provide voice-based reminders. The application supports hands-free interaction through voice commands and delivers all feedback using text-to-speech synthesis, making it fully accessible to users with visual impairments. By combining multiple assistive services into a unified platform and releasing the project as open-source software, the proposed solution aims to encourage community contributions and accelerate the development of accessible technologies. The source code is publicly available at: https://github.com/AOzlemC/LowVisionProject.git
发表机构
- Institut de Robòtica i Informàtica Industrial (CSIC-UPC)（工业机器人与信息学研究所（西班牙国家研究委员会-加泰罗尼亚理工大学））
机构由 AI 辅助整理，请以论文原文为准。
