arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.04104cs.HC
收藏

通过多模态代理视频播放器使视频对视障和低视力用户更加可访问

Making Videos Accessible for Blind and Low Vision Users Using a Multimodal Agent Video Player

GOOGLE(谷歌);PARADIGMS OF INTELLIGENCE(智能范式);GOOGLE RESEARCH(谷歌研究院);COMPUTER SCIENCE DEPARTMENT, STANFORD UNIVERSITY(斯坦福大学计算机科学系)

Adriana Olmos, Anoop K. Sinha, Renelito Delos Santos, Ruben Rodriguez Rodriguez, James A. Landay, Sam S. Sepah, Philip Nelson, Shaun K. Kane

AI总结:

本文提出一种多模态代理视频播放器,通过多层提示编排为视障和低视力用户带来交互式、可访问的视频体验,增强用户自主性和信任感。

摘要:

视频内容仍然 largely 无法被视障和低视力(BLV)用户访问。为了解决这一问题,我们引入了一个原型,该原型利用一个由新型对话架构驱动的多模态代理(基于多模态大语言模型(MLLM))来为BLV用户提供交互式、可访问的视频体验。该多模态代理视频播放器(MAVP)证明,通过多层提示编排可以在视频中添加交互式可访问模式。我们描述了一个涉及18次与BLV用户互动的设计过程,表明BLV用户不仅想要无障碍功能,还渴望在观看体验中拥有独立性和个人自主权。我们还对另外8名BLV参与者进行了定性研究;在此次研究中,我们发现MAVP的对话交流为BLV用户提供了个人自主感,促进了合作与信任。即使在出现幻觉的情况下,关于AI局限性的元对话也能修复信任。

英文摘要:

Video content remains largely inaccessible to blind and low-vision (BLV) users. To address this, we introduce a prototype that leverages a multimodal agent - powered by a novel conversational architecture using a multimodal large language model (MLLM) - to provide BLV users with an interactive, accessible video experience. This Multimodal Agent Video Player (MAVP) demonstrates that an interactive accessibility mode can be added to a video through multilayered prompt orchestration. We describe a user-centered design process involving 18 sessions with BLV users that showed that BLV users do not just want accessibility features, but desire independence and personal agency over the viewing experience. We conducted a qualitative study with an additional 8 BLV participants; in this, we saw that the MAVP's conversational dialogue offers BLV users a sense of personal agency, fostering collaboration and trust. Even in the case of hallucinations, it is meta-conversational dialogues about AI's limitations that can repair trust.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑