arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.12764eess.AScs.LGcs.SDstat.ML
收藏

走向学习一种通用的语音非语义表示

Towards Learning a Universal Non-Semantic Representation of Speech

Google Research(谷歌研究院)

Joel Shor, Aren Jansen, Ronnie Maor, Oran Lang, Omry Tuval, Felix de Chaumont Quitry, Marco Tagliasacchi, Ira Shavitt, Dotan Emanuel, Yinnon Haviv

摘要:

迁移学习的最终目标是通过利用针对不同数据集或任务训练的预先存在的嵌入模型来减少标记数据需求。视觉和语言社区已经建立了比较嵌入的基准,但语音社区还没有这样做。本文提出了一个基准比较语音表示非语义任务,并提出了一种表示的基础上,无监督的三重损失目标。所提出的表示在基准测试中优于其他表示,甚至在许多迁移学习任务上超过了最先进的性能。嵌入在公开可用的数据集上进行训练,并在各种低资源下游任务上进行测试,包括个性化任务和医疗领域。基准、模型和评估代码都是公开发布的。

英文摘要:

The ultimate goal of transfer learning is to reduce labeled data requirements by exploiting a pre-existing embedding model trained for different datasets or tasks. The visual and language communities have established benchmarks to compare embeddings, but the speech community has yet to do so. This paper proposes a benchmark for comparing speech representations on non-semantic tasks, and proposes a representation based on an unsupervised triplet-loss objective. The proposed representation outperforms other representations on the benchmark, and even exceeds state-of-the-art performance on a number of transfer learning tasks. The embedding is trained on a publicly available dataset, and it is tested on a variety of low-resource downstream tasks, including personalization tasks and medical domain. The benchmark, models, and evaluation code are publicly released.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑