TargetSEC: 基于唤醒度条件潜在风格扩散的即插即用野外语音情感转换
TargetSEC: Plug-and-Play In-the-Wild Speech Emotion Conversion via Arousal-Conditioned Latent Style Diffusion
AI总结:
提出TargetSEC,一种基于嵌入驱动的潜在扩散框架,通过连续情感条件生成情感风格嵌入,在紧凑潜在空间操作,实现高转换精度和语音质量。
摘要:
语音情感转换旨在将源话语的情感转换为目标情感,同时保留内容和说话人身份。由于训练数据的非平行性和复杂真实世界声学,野外数据的SEC具有挑战性。现有的固定时长方法要么难以有效转移情感(高质量、低转换),要么降低语音自然度(低质量、高转换)。我们提出TargetSEC,一种嵌入驱动的潜在扩散框架,根据说话人身份和连续情感生成以情感为中心的风格嵌入。与在频谱图上扩散的方法不同,TargetSEC在紧凑潜在空间中操作。在MSP-Podcast数据集上的实验表明,TargetSEC在转换准确性上优于当前非时长基线,同时保持高语音质量,并且在没有显式时间建模的情况下实现了与时长预测系统相当的性能。
英文摘要:
Speech Emotion Conversion (SEC) aims to transform the emotion of a source utterance into a target emotion while preserving content and speaker identity. SEC on in-the-wild data is challenging due to the non-parallel nature of training data and complex real-world acoustics. Existing fixed-duration approaches either struggle to shift the emotion effectively (high quality, low conversion) or degrade speech naturalness (low quality, high conversion). We propose TargetSEC, an embedding-driven latent diffusion framework that generates emotion-focused style embeddings conditioned on speaker identity and continuous emotion. Unlike methods that diffuse over spectrograms, TargetSEC operates in a compact latent space. Experiments on the MSP-Podcast dataset show that TargetSEC outperforms current non-duration baselines and matches or exceeds the duration-prediction baseline in conversion MSE and naturalness without explicit temporal modeling. Demo and code available at.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。