ADCanvas: 为视障和低视力创作者提供可访问且对话式的音频描述创作工具
ADCanvas: Accessible and Conversational Audio Description Authoring for Blind and Low Vision Creators
AI总结:
ADCanvas为视障和低视力创作者提供可访问且对话式的音频描述创作工具,通过多模态交互支持端到端的AD创作和视觉问答。
摘要:
音频描述(AD)为视障和低视力(BLV)观众提供了视觉媒体的重要访问途径。然而,当前的AD制作工具仍然难以被BLV视频创作者使用,尽管他们拥有宝贵的专业知识,但受到视觉驱动界面的限制。我们提出了ADCanvas,一个多模态创作系统,支持非视觉控制的音频描述(AD)创作。ADCanvas结合了对话交互、基于键盘的播放控制以及一个纯文本、屏幕阅读器友好的编辑器,以支持端到端的AD创作和视觉问答(VQA)。结合屏幕阅读友好的控制和一个多模态LLM代理,ADCanvas支持实时VQA、脚本生成和AD修改。通过与12名BLV视频创作者进行的用户研究,我们发现用户将对话代理视为信息助手和草稿助手,同时通过验证和编辑保持自主权。例如,参与者将自己视为策展人,从模型中接收信息并将其过滤下来供其观众。我们的发现为无障碍媒体工具提供了设计启示,包括精确的编辑控制、对创意构思的无障碍支持以及可配置的人机协作规则。
英文摘要:
Audio Description (AD) provides essential access to visual media for blind and low vision (BLV) audiences. Yet current AD production tools remain largely inaccessible to BLV video creators, who possess valuable expertise but face barriers due to visually-driven interfaces. We present ADCanvas, a multimodal authoring system that supports non-visual control over audio description (AD) creation. ADCanvas combines conversational interaction with keyboard-based playback control and a plain-text, screen reader-accessible editor to support end-to-end AD authoring and visual question answering (VQA). Combining screen-reader-friendly controls with a multimodal LLM agent, ADCanvas supports live VQA, script generation, and AD modification. Through a user study with 12 BLV video creators, we find that users adopt the conversational agent as an informational aide and drafting assistant, while maintaining agency through verification and editing. For example, participants saw themselves as curators who received information from the model and filtered it down for their audience. Our findings offer design implications for accessible media tools, including precise editing controls, accessibility support for creative ideation, and configurable rules for human-AI collaboration.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。