通过多模态交互提升视障人士出行体验：NaviGPT，一款实时AI驱动的移动导航系统
Enhancing the Travel Experience for People with Visual Impairments through Multimodal Interaction: NaviGPT, A Real-Time AI-Driven Mobile Navigation System
AI总结：
针对视障人士需在多工具间切换影响导航体验的问题，研究提出整合LiDAR障碍物检测、振动反馈与LLM的NaviGPT系统，通过单系统多模态交互与传感器数据补全延迟，提供实时高效的导航辅助。
摘要：
面向视障人士（PVI）的辅助技术已取得显著进展，尤其是在结合人工智能（AI）与实时传感器技术之后。但现有方案通常需要视障人士在图像识别、导航、障碍物检测等任务的多个应用和工具间切换，会阻碍流畅高效的用户体验。本文提出NaviGPT这一高保真原型，它整合了基于LiDAR（激光雷达）的障碍物检测、振动反馈以及大语言模型（LLM）响应，为视障人士提供全面的实时导航辅助。与Be My AI、Seeing AI等现有应用不同，NaviGPT将图像识别和情境化导航指引整合在单一系统中，无需切换应用即可持续反馈用户周围环境。同时，NaviGPT利用位置和传感器数据弥补LLM的响应延迟，旨在为动态环境中的视障人士提供实用高效的导航支持。
英文摘要：
Assistive technologies for people with visual impairments (PVI) have made significant advancements, particularly with the integration of artificial intelligence (AI) and real-time sensor technologies. However, current solutions often require PVI to switch between multiple apps and tools for tasks like image recognition, navigation, and obstacle detection, which can hinder a seamless and efficient user experience. In this paper, we present NaviGPT, a high-fidelity prototype that integrates LiDAR-based obstacle detection, vibration feedback, and large language model (LLM) responses to provide a comprehensive and real-time navigation aid for PVI. Unlike existing applications such as Be My AI and Seeing AI, NaviGPT combines image recognition and contextual navigation guidance into a single system, offering continuous feedback on the user's surroundings without the need for app-switching. Meanwhile, NaviGPT compensates for the response delays of LLM by using location and sensor data, aiming to provide practical and efficient navigation support for PVI in dynamic environments.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
