SylNet:一种自适应的端到端语音音节计数估计器
SylNet: An Adaptable End-to-End Syllable Count Estimator for Speech
摘要:
自动音节计数估计(SCE)用于各种应用,从说话速率估计到检测可穿戴麦克风的社交活动,或者涉及量化语言学习儿童在不同环境中听到的语音的发展研究。大多数以前使用的SCE方法依赖于启发式DSP方法,只有少数双向长短期记忆(BLSTM)方法在SCE任务中使用了现代机器学习方法。本文提出了一种新的端到端的方法称为SylNet的自动音节计数从语音,建立在神经网络架构的最新发展的基础上。我们描述了整个模型如何可以直接优化,以尽量减少SCE错误的训练数据没有注释对齐在音节水平,以及它如何可以适应新的语言使用有限的语音数据与已知的音节计数。在几种不同语言上的实验表明,SylNet可以推广到训练数据之外的语言,并通过自适应进一步改进。它也优于几个以前提出的音节化方法,包括端到端BLSTM。
英文摘要:
Automatic syllable count estimation (SCE) is used in a variety of applications ranging from speaking rate estimation to detecting social activity from wearable microphones or developmental research concerned with quantifying speech heard by language-learning children in different environments. The majority of previously utilized SCE methods have relied on heuristic DSP methods, and only a small number of bi-directional long short-term memory (BLSTM) approaches have made use of modern machine learning approaches in the SCE task. This paper presents a novel end-to-end method called SylNet for automatic syllable counting from speech, built on the basis of a recent developments in neural network architectures. We describe how the entire model can be optimized directly to minimize SCE error on the training data without annotations aligned at the syllable level, and how it can be adapted to new languages using limited speech data with known syllable counts. Experiments on several different languages reveal that SylNet generalizes to languages beyond its training data and further improves with adaptation. It also outperforms several previously proposed methods for syllabification, including end-to-end BLSTMs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。