SPAM:基于提示的文本到语音的风格提示一致性度量
SPAM: Style Prompt Adherence Metric for Prompt-based TTS
AI总结:
SPAM是一种用于评估基于提示的文本到语音系统中风格提示一致性的自动度量,通过声学属性对齐和监督对比损失提升评估的合理性和忠实性。
摘要:
基于提示的文本到语音(TTS)旨在生成符合文本提示中细粒度风格线索的语音。然而,大多数先前工作既不依赖于合理的也不忠实的度量来评估提示一致性。也就是说,它们无法确保评估是否基于提示并与人类相似。因此,我们提出了一种新的自动度量,即风格提示一致性度量(SPAM),它明确满足了合理性和忠实性。受CLAP启发,我们的方法将语音分解为声学属性,并将其与风格提示对齐。此外,我们用监督对比损失训练了评分器,这可以提供更清晰的不同语义区别的区分。我们在两个视角上进行了两个实验。可信度实验表明,SPAM与平均意见分数(MOS)之间有很强的相关性。此外,忠实度实验表明,SPAM成功地与给定的风格提示相关联,因为它能够区分提示的不同语义。我们相信,SPAM可以为评估合成语音的风格提示一致性提供可行的自动解决方案。
英文摘要:
Prompt-based text-to-speech (TTS) aims to generate speech that adheres to fine-grained style cues provided in a text prompt. However, most prior works depend on neither plausible nor faithful measures to evaluate prompt adherence. That is, they cannot ensure whether the evaluation is grounded on the prompt and is similar to a human. Thus, we present a new automatic metric, the Style Prompt Adherence Metric, which explicitly satisfies both plausibility and faithfulness. Inspired by the CLAP, our approach factorizes speech into acoustic attributes and aligns them with the style prompt. Also, we trained the scorer with a supervised contrastive loss, which could provide a clearer distinction between different semantics. We conducted two experiments on two perspectives. The plausibility experiment showed that SPAM achieved a strong correlation with the mean opinion score (MOS). Also, the faithfulness experiment demonstrated that SPAM is successfully grounded to the given style prompt, as it can discriminate different semantics of the prompt. We believe that SPAM can provide a viable automatic solution for evaluating style prompt adherence of synthesized speech.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。