arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.12998eess.AS
收藏

VoxLingua107:一个用于口语识别的数据集

VoxLingua107: a Dataset for Spoken Language Recognition

Jörgen Valk, Tanel Alumäe

摘要:

本文研究了使用自动收集的网络音频数据的口语识别任务。我们从特定语言的维基百科数据中生成半随机搜索短语,然后用于从YouTube检索107种语言的视频。语音活动检测和说话人日记用于从包含语音的视频中提取片段。后过滤用于从数据库中删除可能不是给定语言的片段,基于众包验证,将正确标记的片段的比例提高到98%。所得到的训练集(VoxLingua107)的大小为6628小时(平均每种语言62小时),并且它伴随着1609个经验证的话语的评估集。我们使用这些数据来建立几个口语识别任务的语言识别模型。实验表明,使用自动检索的训练数据提供了竞争力的结果,使用手工标记的专有数据集。数据集是公开的。

英文摘要:

This paper investigates the use of automatically collected web audio data for the task of spoken language recognition. We generate semi-random search phrases from language-specific Wikipedia data that are then used to retrieve videos from YouTube for 107 languages. Speech activity detection and speaker diarization are used to extract segments from the videos that contain speech. Post-filtering is used to remove segments from the database that are likely not in the given language, increasing the proportion of correctly labeled segments to 98%, based on crowd-sourced verification. The size of the resulting training set (VoxLingua107) is 6628 hours (62 hours per language on the average) and it is accompanied by an evaluation set of 1609 verified utterances. We use the data to build language recognition models for several spoken language identification tasks. Experiments show that using the automatically retrieved training data gives competitive results to using hand-labeled proprietary datasets. The dataset is publicly available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑