Re:Member:基于个人记忆的情感化问题生成
Re:Member: Emotional Question Generation from Personal Memories
AI总结:
该研究提出Re:Member系统,通过利用用户个人视频生成目标语言风格化口语问题,结合情感语音合成与多模态技术,探索情感化记忆交互对第二语言学习的支持作用,突显情感与个人媒体在教育技术中的价值。
摘要:
我们提出Re:Member系统,探索情感丰富、以记忆为基础的交互如何支持更具吸引力的第二语言(L2)学习。该系统利用用户的个人视频,生成目标语言的风格化口语问题,旨在鼓励情感回忆和对话参与。系统将情感基调与视觉语境对齐,使用耳语或深夜语调等富有表现力的语音风格唤起特定情绪。它在模块化生成流程中结合了基于WhisperX的转录对齐、3帧视觉采样和Style-BERT-VITS2情感合成技术。作为风格化交互探针,Re:Member突显了情感和个人媒体在以学习者为中心的教育技术中的作用。
英文摘要:
We present Re:Member, a system that explores how emotionally expressive, memory-grounded interaction can support more engaging second language (L2) learning. By drawing on users' personal videos and generating stylized spoken questions in the target language, Re:Member is designed to encourage affective recall and conversational engagement. The system aligns emotional tone with visual context, using expressive speech styles such as whispers or late-night tones to evoke specific moods. It combines WhisperX-based transcript alignment, 3-frame visual sampling, and Style-BERT-VITS2 for emotional synthesis within a modular generation pipeline. Designed as a stylized interaction probe, Re:Member highlights the role of affect and personal media in learner-centered educational technologies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。