arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.17701eess.AScs.LGcs.SD
收藏

使用混合频谱图-TasNet的实时低延迟音乐源分离

Real-time Low-latency Music Source Separation using Hybrid Spectrogram-TasNet

L-Acoustics(L-声学)

Satvik Venkatesh, Arthur Benilov, Philip Coleman, Frederic Roskam

AI总结:

本文针对实时低延迟音乐源分离需求,提出HS-TasNet混合频谱图与时域波形优势,在23 ms延迟下于MusDB上取得4.65 SDR,额外数据训练后提升至5.55。

摘要:

近年来,深度学习在音乐去混音方面取得了显著进展。然而,关于如何将这些神经网络适配于实时低延迟应用的研究却很少,这类应用可能对助听器、音频流重混音和现场演出有帮助。本文研究了将文献中现有的去混音模型适配到这一使用场景所涉及的各种挑战。随后,受Hybrid Demucs架构启发,我们提出了混合频谱图时域音频分离网络HS-TasNet,该网络利用了频谱域和波形域的优势。在23 ms延迟下,HS-TasNet在MusDB测试集上获得了4.65的整体信号失真比(SDR),并且在使用额外训练数据后提升至5.55。这些结果展示了高效去混音在实时低延迟音乐应用中的潜力。

英文摘要:

There have been significant advances in deep learning for music demixing in recent years. However, there has been little attention given to how these neural networks can be adapted for real-time low-latency applications, which could be helpful for hearing aids, remixing audio streams and live shows. In this paper, we investigate the various challenges involved in adapting current demixing models in the literature for this use case. Subsequently, inspired by the Hybrid Demucs architecture, we propose the Hybrid Spectrogram Time-domain Audio Separation Network HS-TasNet, which utilises the advantages of spectral and waveform domains. For a latency of 23 ms, the HS-TasNet obtains an overall signal-to-distortion ratio (SDR) of 4.65 on the MusDB test set, and increases to 5.55 with additional training data. These results demonstrate the potential of efficient demixing for real-time low-latency music applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑