arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.13668cs.DCcs.CYcs.HC
收藏

Audo-Sight:基于边缘-云的AI驱动环境感知系统用于视障和低视力用户

Audo-Sight: AI-driven Ambient Perception Across Edge-Cloud for Blind and Low Vision Users

University of North Texas College of Engineering(北德克萨斯大学工程学院)

Jacob Bradshaw, Mohsen Riahi Alam, Bhanuja Ainary, Minseo Kim, Mohsen Amini Salehi

AI总结:

本文提出Audo-Sight系统,通过边缘-云协同实现视障用户环境感知,利用AI代理动态路由查询,融合边缘快速响应与云准确信息,提升响应速度和准确性。

摘要:

尽管辅助技术有所进展,视障和低视力(BLV)个体仍面临理解周围环境的挑战。本文提出Audo-Sight,一种基于边缘-云的AI驱动辅助系统,通过语音交互帮助BLV用户感知环境。系统采用专家和通用AI代理,结合边缘和云处理管道,根据紧急性和上下文信息推断用户意图并动态路由查询。边缘快速生成响应,云提供更详细准确信息,通过响应融合引擎整合输出,确保及时高精度响应。系统评估显示,Audo-Sight在紧急任务中响应速度比商业云方案快80%,整体任务响应快50%。人机评估表明,62%的BLV参与者更倾向于Audo-Sight,23%认为与GPT-5相当。

英文摘要:

Despite advances in assistive technologies, Blind and Low-Vision (BLV) individuals continue to face challenges in understanding their surroundings. Delivering concise, useful, and timely scene descriptions for ambient perception remains a long-standing problem in accessibility. Existing solutions often fail to identify user expectations for real-time and accessible responses. Moreover, for a given task, they either rely on cloud offloading, which imposes a significant delay, or edge-based AI, which often sacrifices accuracy. To address this, we present Audo-Sight, an AI-driven assistive system that spans across Edge-Cloud continuum and enables BLV individuals to perceive their surroundings through voice-based conversation. Audo-Sight provides low-latency, accurate, and human-friendly responses through a novel mechanism that seamlessly fuses Edge and Cloud responses. The system also addresses challenges in catering to BLV users through response editing informed by BLV needs. Audo-Sight orchestrates a set of AI models based on user query contextual analysis to infer intent and adjust for a variety of situations. In urgent cases where users require fast responses, Audo-Sight leverages parallel Edge and Cloud pipelines and seamlessly combines responses through its Response Fusion Engine. Systematic evaluation shows that Audo-Sight delivers speech output around 80% faster for urgent tasks and generates complete responses approximately 50% faster across all tasks compared to a commercial cloud-based solution---highlighting the need for customized AI-based solutions. Human evaluation of Audo-Sight shows that it is the preferred choice over GPT-5 for 62% of BLV participants with another 23% stating both perform comparably. Speed and interruption evaluations demonstrate that in most situations, the system can seamlessly respond at a rapid pace to keep up with BLV expectations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑