适应性字幕与情感提示:支持聋人及神经多样性学习者在STEM领域
Adaptive Captioning with Emotional Cues: Supporting DHH and Neurodivergent Learners in STEM
AI总结:
本文探讨了四种嵌入情感和多模态提示的字幕原型,通过实验证明其能降低认知负荷并提升理解成绩,强调了为神经多样性用户定制字幕功能的重要性。
摘要:
实时字幕对聋人及听力障碍者和神经多样性学习者(如ADHD患者)至关重要,但通常忽略了情感和非语言提示,这对STEM教育尤其关键,因为认知负荷高的内容会加剧不同能力水平学习者的挑战。本文提出了四种嵌入情感和多模态提示的字幕原型,包括面部表情、身体动作、关键词高亮和表情符号。在24名参与者的试点和主要研究中,发现某些原型相比传统字幕减少了自我报告的认知负荷并提高了理解分数。定性反馈显示,可定制的字幕功能对满足神经多样性用户偏好(如ADHD或对表情符号的不同舒适度)至关重要。我们的发现为可及性技术研究提供了贡献,探讨了如何在字幕中整合情感提示,以在广泛学习者中实现可用性和益处。
英文摘要:
Real-time captioning is vital for Deaf and Hard of Hearing (DHH) and neurodivergent learners (e.g., those with ADHD), yet it often omits emotional and non-verbal cues essential for comprehension. This omission is particularly consequential in STEM education, where cognitively demanding material can exacerbate the challenges faced by caption users across diverse ability profiles. In this paper, we present a design-oriented exploration of four captioning prototypes that embed emotional and multimodal cues, including facial expressions, body gestures, keyword highlighting, and emoji. Across a pilot and a main study with 24 participants, we found that certain prototypes reduced self-reported cognitive load and improved comprehension scores compared to traditional captions. Qualitative feedback reveals the importance of customizable caption features to accommodate neurodivergent users' preferences (e.g., ADHD or different levels of comfort with emojis). Our findings contribute to ongoing conversations in accessible technology research about how best to integrate emotional cues into captions in a way that is both usable and beneficial for a wide range of learners.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。