AD4EDU:基于无障碍标准、指标与学习者偏好的大学讲座音频描述基准
AD4EDU: Benchmarking University Lecture Audio Description across Accessibility Standards, Metrics, and Learner Preferences
AI总结:
本研究针对高等教育讲座音频描述的适配问题,构建了含基准与评估指标的AD4Edu框架,发现合规音频描述未必满足盲低视力人群偏好,强调需其参与包容性AI设计。
摘要:
音频描述(AD)旨在为盲人和低视力(BLV)人群提升视觉媒体的可访问性。然而在高等教育领域,以幻灯片为基础的讲座是默认教学模式,讲座音频描述却仍未得到充分探索。主要原因在于现有制作指南、评估指标及基准数据集均面向娱乐内容,无法适配讲座场景——讲座中的音频描述必须补充讲师的讲话、解决指示性指代问题,并适配狭窄的停顿间隙。本研究提出AD4Edu,包含用于生成和评估高等教育音频描述的基准AD4Edu-Bench,以及可规则诊断的评估指标AD4Edu-Eval。具体而言,我们整合了已确立的无障碍指南,包括WCAG 2.2、DCMP描述关键标准及NCAM的STEM描述实践;还收集了银标准参考音频描述、评判者排序的偏好对,以及四名BLV评判者的成对偏好,并通过直接偏好优化(DPO)对模型进行后训练以开展详细分析。研究结果表明,该指标虽能可靠检测对标准的违反情况,但符合标准的音频描述未必满足BLV人群的主观偏好,尤其是在描述长度方面,这凸显了BLV人群共同设计包容性AI解决方案的必要性。
英文摘要:
Audio description (AD) aims to enhance the accessibility of visual media for blind and low-vision (BLV) persons. However, in higher education, where slide-based lectures are a default mode of teaching, lecture AD remains largely underexplored. The main reason is that existing production guidelines, evaluation metrics, and benchmark datasets are oriented toward entertainment content and do not transfer to lectures, where ADs must complement the lecturer's speech, resolve deictic references, and fit within narrow pauses. In this work, we propose AD4Edu, consisting of an AD benchmark, AD4Edu-Bench, and a rule-diagnosable evaluation metric, AD4Edu-Eval, for generating and evaluating ADs in higher education. Specifically, we consolidated established accessibility guidance, including WCAG 2.2, the DCMP Description Key, and NCAM's STEM description practices. We further collected silver reference ADs, judge-ordered preference pairs, and pairwise preferences from four BLV raters, and post-trained models with direct preference optimization (DPO) for detailed analysis. Our findings indicate that while the metric reliably detects violations of the standard, ADs that comply with it do not necessarily fulfill the subjective preferences of BLV persons, most notably on description length, underscoring the necessity of active participation of BLV persons in co-designing inclusive AI solutions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。