屏障还是助推？熟悉度对使用AI语音克隆识别普通话情绪韵律的影响
A barrier or a booster? Familiarity effects on Mandarin emotion prosody recognition using AI-powered voice cloning
- Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所）
- Macquarie University（麦考瑞大学）
机构由 AI 辅助整理，请以论文原文为准。
中文总结 AI 辅助
本研究考察语音来源与说话者熟悉度对情绪韵律识别的影响，发现人类语音优于AI语音，且解码合成语音受社会认知调控，揭示AI合成技术的局限。
中文摘要 AI 辅助
情绪韵律感知需要同时处理声学线索和说话者身份。虽然听者能毫不费力地解码自然语音，但AI合成语音因细微的声学非典型性而引入了认知复杂性。目前尚不清楚这些合成特征如何与听者先前对熟悉说话者的社会知识和记忆相互作用。本研究探讨了语音来源（人类 vs. AI）和说话者熟悉度如何影响情绪识别准确性和认知负荷。一项针对讲普通话成年人的被试内任务评估了行为数据（准确性、反应时间）和生理数据（心率变异性）。结果显示，人类语音产生的准确性和处理速度显著高于AI语音，而心率变异性在各条件间无显著差异。这些发现表明，解码合成语音受自上而下的社会认知调控，凸显了当前AI合成技术的局限性。
英文摘要
Emotion prosody perception requires simultaneous processing of acoustic cues and speaker identity. While listeners effortlessly decode natural speech, AI synthetic voices introduce cognitive complexities due to subtle acoustic atypicalities. It remains unclear how these synthetic features interact with a listener's prior social knowledge and memory of a familiar speaker. This study investigated how speech sources (human vs. AI) and speaker familiarity affect emotion recognition accuracy and cognitive load. A within-subject task with Mandarin-speaking adults evaluated behavioral (accuracy, reaction time) and physiological data (heart rate variability). Results showed that human voices yielded significantly higher accuracy and faster processing times than AI voices, while HRV did not significantly differentiate between conditions. These findings show that decoding synthetic speech is gated by top-down social cognition, highlighting limitations in current AI synthesis technologies.
