arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.11262eess.AS
收藏

LibriMix:一个用于通用语音分离的开源数据集

LibriMix: An Open-Source Dataset for Generalizable Speech Separation

Joris Cosentino, Manuel Pariente, Samuele Cornell, Antoine Deleforge, Emmanuel Vincent

摘要:

近年来,wsj 0 - 2 mix已成为单通道语音分离的参考数据集。如今,大多数基于深度学习的语音分离模型都是以它为基准的,然而,最近的研究表明,当在wsj 0 - 2 mix上训练的模型在其他类似的数据集上进行评估时,性能会大幅下降。为了解决这个泛化问题,我们创建了LibriMix,它是wsj 0 - 2 mix及其噪声扩展WHAM!的开源替代品。LibriMix基于LibriSpeech,由两个或三个扬声器的混合声与来自WHAM!的环境噪声样本组成。使用Conv-TasNet,我们在所有LibriMix版本上都实现了具有竞争力的性能。为了公平地评估数据集,我们引入了第三个基于语音和WHAM的VCTK测试集!噪音。我们的实验表明,使用LibriMix训练的模型的泛化误差比使用WHAM!在干净和嘈杂的条件下。为了在更现实、类似对话的场景中进行评估,我们还发布了LibriMix测试集的一个稀疏重叠版本。

英文摘要:

In recent years, wsj0-2mix has become the reference dataset for single-channel speech separation. Most deep learning-based speech separation models today are benchmarked on it. However, recent studies have shown important performance drops when models trained on wsj0-2mix are evaluated on other, similar datasets. To address this generalization issue, we created LibriMix, an open-source alternative to wsj0-2mix, and to its noisy extension, WHAM!. Based on LibriSpeech, LibriMix consists of two- or three-speaker mixtures combined with ambient noise samples from WHAM!. Using Conv-TasNet, we achieve competitive performance on all LibriMix versions. In order to fairly evaluate across datasets, we introduce a third test set based on VCTK for speech and WHAM! for noise. Our experiments show that the generalization error is smaller for models trained with LibriMix than with WHAM!, in both clean and noisy conditions. Aiming towards evaluation in more realistic, conversation-like scenarios, we also release a sparsely overlapping version of LibriMix's test set.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑