arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.08464eess.AScs.SD
收藏

众包与自动语音显著性估计

Crowdsourced and Automatic Speech Prominence Estimation

Northwestern University(西北大学)

Max Morrison, Pranav Pawar, Nathan Pruyne, Jennifer Cole, Bryan Pardo

AI总结:

本文提出众包标注与神经估计器,用于语音显著性估计,并开源LibriTTS子集标注,研究数据量与每句标注数对性能的影响。

摘要:

口语词汇的显著性是指普通母语听众相对于上下文感知该词为突出或强调的程度。语音显著性估计是为话语中每个单词分配一个数值以表示其显著性的过程。这些显著性标签对于语言分析以及训练自动化系统执行强调控制的文本转语音或情感识别非常有用。手动标注显著性耗时且昂贵,这推动了开发自动化语音显著性估计方法的动机。然而,使用机器学习方法开发这样的自动化系统需要人工标注的训练数据。利用我们获取此类人工标注的系统,我们收集并开源了LibriTTS数据集一部分的众包标注。我们将这些标注作为真实值来训练一个神经语音显著性估计器,该估计器能够泛化到未见过的说话人、数据集和说话风格。我们研究了神经显著性估计的设计决策,以及神经显著性估计如何随着标注成本的两个关键因素——数据集大小和每个话语的标注数量——而改进。

英文摘要:

The prominence of a spoken word is the degree to which an average native listener perceives the word as salient or emphasized relative to its context. Speech prominence estimation is the process of assigning a numeric value to the prominence of each word in an utterance. These prominence labels are useful for linguistic analysis, as well as training automated systems to perform emphasis-controlled text-to-speech or emotion recognition. Manually annotating prominence is time-consuming and expensive, which motivates the development of automated methods for speech prominence estimation. However, developing such an automated system using machine-learning methods requires human-annotated training data. Using our system for acquiring such human annotations, we collect and open-source crowdsourced annotations of a portion of the LibriTTS dataset. We use these annotations as ground truth to train a neural speech prominence estimator that generalizes to unseen speakers, datasets, and speaking styles. We investigate design decisions for neural prominence estimation as well as how neural prominence estimation improves as a function of two key factors of annotation cost: dataset size and the number of annotations per utterance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑