arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2206.02124eess.AScs.SD
收藏

与采样频率无关的对话分离

Sampling Frequency Independent Dialogue Separation

Fraunhofer Institute for Integrated Circuits IIS(弗劳恩霍夫集成电路研究所IIS);International Audio Laboratories Erlangen(埃尔朗根国际音频实验室);Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡大学);WS Audiology(WS听力集团)

Jouni Paulus, Matteo Torcoli

摘要:

在用于音频源分离的一些DNN中,相关模型参数与用于训练的音频的采样频率无关。考虑到对话分离的应用,这是针对两种DNN架构显示的:U-Net和全卷积模型。这些模型使用以8 kHz采样的音频进行训练。学习的参数被传输到模型中,用于处理48 kHz的音频。将分离的音频源与由相同训练数据的48 kHz版本训练的相同模型架构产生的音频源进行比较。听力测试和计算测量表明,用8 kHz或48 kHz训练的模型之间没有显着的感知差异。学习参数的这种可传递性允许更快和计算成本更低的训练。它还允许使用比应用程序所需的采样频率更低的训练数据集,或者使用具有多个采样频率的数据集合。

英文摘要:

In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two DNN architectures: a U-Net and a fully-convolutional model. The models are trained with audio sampled at 8 kHz. The learned parameters are transferred to models for processing audio at 48 kHz. The separated audio sources are compared with the ones produced by the same model architectures trained with 48 kHz versions of the same training data. A listening test and computational measures show that there is no significant perceptual difference between the models trained with 8 kHz or with 48 kHz. This transferability of the learned parameters allows for a faster and computationally less costly training. It also enables using training datasets available at a lower sampling frequency than the one needed by the application at hand, or using data collections with multiple sampling frequencies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑