arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.00819cs.SDcs.CLeess.AS

LibriheavyMix:一个用于单通道混响多说话人语音分离、自动语音识别和说话人日志的20,000小时数据集

LibriheavyMix: A 20,000-Hour Dataset for Single-Channel Reverberant Multi-Talker Speech Separation, ASR and Speaker Diarization

Xiaomi Corp.(小米公司);Tencent AI Lab(腾讯AI实验室);The Chinese University of Hong Kong(香港中文大学)

Zengrui Jin, Yifan Yang, Mohan Shi, Wei Kang, Xiaoyu Yang, Zengwei Yao, Fangjun Kuang, Liyong Guo, Lingwei Meng, Long Lin, Yong Xu, Shi-Xiong Zhang, Daniel Povey

AI总结:

本文发布LibriheavyMix大规模远场重叠语音数据集,并构建分离-识别-日志流水线基准,以解决单通道混响多说话人场景下“谁在何时说了什么”的难题。

摘要:

语音处理领域的发展日益聚焦于复杂场景,例如具有多个同时说话人和远场条件的会议或鸡尾酒会。现有应对这些挑战的方法分为两类:多通道和单通道解决方案。单通道方法以其通用性和便利性著称,不需要关于麦克风阵列的具体信息。本文提出了一个大规模远场重叠语音数据集,旨在推进语音分离、识别和说话人日志的研究。该数据集是解码多说话人混响环境中“谁在何时说了什么”这一领域内艰巨挑战的关键资源。此外,我们引入了一个包含语音分离、识别和日志的流水线系统,作为基础基准。在WHAMR!数据集上的评估验证了所提出数据的广泛适用性。

英文摘要:

The evolving speech processing landscape is increasingly focused on complex scenarios like meetings or cocktail parties with multiple simultaneous speakers and far-field conditions. Existing methodologies for addressing these challenges fall into two categories: multi-channel and single-channel solutions. Single-channel approaches, notable for their generality and convenience, do not require specific information about microphone arrays. This paper presents a large-scale far-field overlapping speech dataset, crafted to advance research in speech separation, recognition, and speaker diarization. This dataset is a critical resource for decoding ``Who said What and When'' in multi-talker, reverberant environments, a daunting challenge in the field. Additionally, we introduce a pipeline system encompassing speech separation, recognition, and diarization as a foundational benchmark. Evaluations on the WHAMR! dataset validate the broad applicability of the proposed data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑