Audo-Sight:基于边缘-云的AI驱动环境感知系统用于视障和低视力用户
Audo-Sight: AI-driven Ambient Perception Across Edge-Cloud for Blind and Low Vision Users
AI总结:
本文提出Audo-Sight系统,通过边缘-云协同实现视障用户环境感知,利用AI代理动态路由查询,融合边缘快速响应与云准确信息,提升响应速度和准确性。
摘要:
尽管辅助技术有所进展,视障和低视力(BLV)个体仍面临理解周围环境的挑战。本文提出Audo-Sight,一种基于边缘-云的AI驱动辅助系统,通过语音交互帮助BLV用户感知环境。系统采用专家和通用AI代理,结合边缘和云处理管道,根据紧急性和上下文信息推断用户意图并动态路由查询。边缘快速生成响应,云提供更详细准确信息,通过响应融合引擎整合输出,确保及时高精度响应。系统评估显示,Audo-Sight在紧急任务中响应速度比商业云方案快80%,整体任务响应快50%。人机评估表明,62%的BLV参与者更倾向于Audo-Sight,23%认为与GPT-5相当。
英文摘要:
Despite advances in assistive technologies, Blind and Low-Vision (BLV) individuals continue to face challenges in understanding their surroundings. Delivering concise, useful, and timely scene descriptions for ambient perception remains a long-standing problem in accessibility. Existing solutions often fail to identify user expectations for real-time and accessible responses. Moreover, for a given task, they either rely on cloud offloading, which imposes a significant delay, or edge-based AI, which often sacrifices accuracy. To address this, we present Audo-Sight, an AI-driven assistive system that spans across Edge-Cloud continuum and enables BLV individuals to perceive their surroundings through voice-based conversation. Audo-Sight provides low-latency, accurate, and human-friendly responses through a novel mechanism that seamlessly fuses Edge and Cloud responses. The system also addresses challenges in catering to BLV users through response editing informed by BLV needs. Audo-Sight orchestrates a set of AI models based on user query contextual analysis to infer intent and adjust for a variety of situations. In urgent cases where users require fast responses, Audo-Sight leverages parallel Edge and Cloud pipelines and seamlessly combines responses through its Response Fusion Engine. Systematic evaluation shows that Audo-Sight delivers speech output around 80% faster for urgent tasks and generates complete responses approximately 50% faster across all tasks compared to a commercial cloud-based solution---highlighting the need for customized AI-based solutions. Human evaluation of Audo-Sight shows that it is the preferred choice over GPT-5 for 62% of BLV participants with another 23% stating both perform comparably. Speed and interruption evaluations demonstrate that in most situations, the system can seamlessly respond at a rapid pace to keep up with BLV expectations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。