AI 中文总结
研究针对盲人观众在对话场景中理解视频困难的问题，提出Sonic Stage系统，运用空间化对话、环境音效和交互式描述三种听觉技术，将对话视频转换为交互式空间音景，显著提升了盲人观众的视频理解等能力。
AI 中文摘要
音频描述（AD）通过叙述角色动作让盲人和低视力（BLV）观众能够观看影视。然而，在大量对话场景中，AD常因不能与语音重叠而省略重要动作，目前尚不知如何在对话中传达角色动作。我们提出Sonic Stage系统，它将对话视频转换为交互式空间音景，使BLV观众能通过沉浸式听觉线索直观理解角色动作和移动。该系统通过三种听觉技术在对话中传达关键视觉信息：（1）空间化对话表示空间布局，（2）环境音效传达角色动作，（3）交互式描述提供特定情境视觉细节。对12名BLV观众的评估表明，Sonic Stage显著提高了视频理解、空间沉浸感和叙事参与度。我们强调了通过沉浸式、交互式音频表示增强不同类型视频可访问性的机会。
英文摘要
Audio description (AD) makes film and television accessible to blind and low-vision (BLV) audiences by narrating characters' actions. However, in scenes with lots of dialogue, AD often omits important actions because it is constrained not to overlap with speech. It is not yet known how to convey characters' actions during dialogue. We present Sonic Stage, a system that transforms dialogue videos into interactive spatial soundscapes, enabling BLV audiences to intuitively understand characters' actions and movements through immersive auditory cues. Sonic Stage conveys essential visual information during dialogue through three auditory techniques: (1) spatialized dialogue to represent spatial layout, (2) diegetic sound to convey character actions, and (3) interactive descriptions to provide context-specific visual details. Evaluation with 12 BLV viewers showed that Sonic Stage significantly improved video comprehension, spatial presence, and narrative engagement. We highlight opportunities for enhancing video accessibility across diverse genres through immersive, interactive audio representations.
Commentsaccepted to UIST 2026
