Gesture2Speech: How Far Can Hand Movements Shape Expressive Speech?
Gesture2Speech: 手部动作能多大程度上塑造表现性语音?
AI总结 本文提出Gesture2Speech框架,利用视觉手势线索调节合成语音的语调,通过多模态MoE架构动态融合语言内容和手势特征,提升语音自然度和手势与语调的同步性。
Comments Accepted at The 2nd International Workshop on Bodily Expressed Emotion Understanding (BEEU) at AAAI 2026 [non-archival]