arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.11596cs.HC
收藏

GlobalizeEd:一种在学术讲座中保留演讲者身份的多模态翻译系统

GlobalizeEd: A Multimodal Translation System that Preserves Speaker Identity in Academic Lectures

Chonnam National University(全南国立大学);FPT University(FPT大学)

Hoang-Son Vo, Karina Kolmogortseva, Ngumimi Karen Iyortsuun, Hong-Duyen Vo, Soo-Hyung Kim

AI总结:

针对学术讲座翻译中自动字幕缺乏教学语气且增加认知负荷的问题,提出多模态翻译系统GlobalizeEd,通过保留演讲者身份的配音格式降低认知负荷并提升沉浸感,为跨语言教育贡献了以人为中心的AI框架。

摘要:

大量有价值的学术内容仅以原始语言提供,这为全球学生群体造成了重大的访问障碍。这在历史、文化和艺术等多个学科的翻译中是一项挑战,因为当前的自动字幕工具无法传达恰当的教学语气和专业含义。此外,阅读传统的自动字幕会增加认知负荷,并导致学习体验脱节。通过一项涉及36名参与者的混合方法研究,我们发现,与传统字幕相比,GlobalizeEd的配音格式显著降低了认知负荷,并提供了更具沉浸感的学习体验。尽管高质量字幕和配音格式的学习效果相当,但两组参与者都看重GlobalizeEd保留演讲者声音的能力,这增强了感知的真实性。讲师对翻译准确性和声音自然度进行了评分,而学生则报告说,同步且保留身份的输出促进了参与感和信任。这项工作为跨语言教育贡献了一个新颖的以人为中心的AI框架,展示了多模态翻译系统如何平衡语言保真度、文化适应性和用户控制,以创造更具包容性的全球学习体验。

英文摘要:

A large amount of valuable academic content is only available in its original language, creating a significant access barrier for the global student community. This is a challenge for translating in several subjects, such as history, culture, and the arts, where current automated subtitle tools fail to convey the appropriate pedagogical tone and specialized meaning. In addition, reading traditional automated subtitles increases cognitive load and leads to a disconnected learning experience. Through a mixed-methods study involving 36 participants, we found that GlobalizeEds dubbed formats significantly reduce cognitive load and offer a more immersive learning experience compared to traditional subtitles. Although learning effectiveness was comparable between high-quality subtitles and dubbed formats, both groups valued GlobalizeEds ability to preserve the speakers voice, which enhanced perceived authenticity. Instructors rated translation accuracy and vocal naturalness, whereas students reported that synchronized, identity-preserving outputs fostered engagement and trust. This work contributes a novel human-centered AI framework for cross-lingual education, demonstrating how multimodal translation systems can balance linguistic fidelity, cultural adaptability, and user control to create more inclusive global learning experiences.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑