arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2505.08072cs.HC
收藏

捕捉手语情感表达的视角

Perspectives on Capturing Emotional Expressiveness in Sign Language

Phoebe Chua, Cathy Mengying Fang, Yasith Samaradivakara, Pattie Maes, Suranga Nanayakkara

AI总结:

本研究通过访谈多国8名手语使用者,考察手部与非手部情感表达及文化差异,并提出情感感知手语技术的设计建议。

摘要:

我们在理解和生成文本、语音等情感表达内容方面已取得重大进展,但手语技术中的同类进展仍然有限。尽管手语翻译的计算方法一直侧重于捕捉词汇内容,手语交流的情感维度在很大程度上仍未得到探索。通过对新加坡、斯里兰卡和美国的8名手语使用者进行半结构化访谈,其中包括聋人与重听(DHH)人士以及健听手语使用者,我们研究了情感在手语中如何被表达和感知。研究结果强调了手部和非手部元素在情感表达中的作用,揭示了手语使用者交流情感时的普遍模式以及个体和文化差异。我们识别了在手语翻译中捕捉情感细微差别的关键挑战,并提出了开发更具情感意识的手语技术的设计考量。这项工作有助于从理论上理解手语中的情感表达,也有助于实际开发界面,以更好地服务于多样化的手语社群。

英文摘要:

Significant advances have been made in our ability to understand and generate emotionally expressive content such as text and speech, yet comparable progress in sign language technologies remain limited. While computational approaches to sign language translation have focused on capturing lexical content, the emotional dimensions of sign language communication remain largely unexplored. Through semi-structured interviews with eight sign language users across Singapore, Sri Lanka and the United States, including both Deaf and Hard of hearing (DHH) and hearing signers, we investigate how emotions are expressed and perceived in sign languages. Our findings highlight the role of both manual and non-manual elements in emotional expression, revealing universal patterns as well as individual and cultural variations in how signers communicate emotions. We identify key challenges in capturing emotional nuance for sign language translation, and propose design considerations for developing more emotionally-aware sign language technologies. This work contributes to both theoretical understanding of emotional expression in sign language and practical development of interfaces to better serve diverse signing communities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑