arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.07645eess.AScs.LGcs.SD
收藏

基于深度学习的源分离在Choir合奏中的应用

Deep Learning Based Source Separation Applied To Choir Ensembles

Music Technology Group, Universitat Pompeu Fabra(庞培法布拉大学音乐技术集团);European Commission, Joint Research Centre(欧盟委员会联合研究中心)

Darius Petermann, Pritish Chandna, Helena Cuesta, Jordi Bonada, Emilia Gomez

摘要:

合唱是一种广泛使用的合唱形式,其中一群人在复调和声中同时演唱。合唱团最常见的设置由四个部分组成;女高音,女低音,男高音和低音(SATB),每个部分都有自己的基频范围(F $0$ s)。在这种合唱环境中,源分离的任务需要将SATB混合物分离成组成部分。音乐混合的源分离已经得到了很好的研究,并且已经提出了许多基于深度学习的方法。然而,大多数研究都集中在一个典型的情况下,其中包括分离声乐,打击乐和低音源的混合,其中每一个都有一个独特的频谱结构。相比之下,合奏歌唱的同时和谐波性质导致合唱混合物中源的光谱分量之间的高度结构相似性和重叠,使得合唱团的源分离比典型情况更难。这一点,加上缺乏适当的综合数据集,导致迄今为止该领域缺乏研究。在本文中,我们首先评估如何以及最近开发的音乐源分离的方法执行的情况下,SATB合唱团。然后,我们提出了一种新的特定于域的适应条件最近提出的U-Net架构的音乐源分离使用的基本频率轮廓的每个歌唱组,并证明我们提出的方法超越域不可知的架构的结果。

英文摘要:

Choral singing is a widely practiced form of ensemble singing wherein a group of people sing simultaneously in polyphonic harmony. The most commonly practiced setting for choir ensembles consists of four parts; Soprano, Alto, Tenor and Bass (SATB), each with its own range of fundamental frequencies (F$0$s). The task of source separation for this choral setting entails separating the SATB mixture into the constituent parts. Source separation for musical mixtures is well studied and many deep learning based methodologies have been proposed for the same. However, most of the research has been focused on a typical case which consists in separating vocal, percussion and bass sources from a mixture, each of which has a distinct spectral structure. In contrast, the simultaneous and harmonic nature of ensemble singing leads to high structural similarity and overlap between the spectral components of the sources in a choral mixture, making source separation for choirs a harder task than the typical case. This, along with the lack of an appropriate consolidated dataset has led to a dearth of research in the field so far. In this paper we first assess how well some of the recently developed methodologies for musical source separation perform for the case of SATB choirs. We then propose a novel domain-specific adaptation for conditioning the recently proposed U-Net architecture for musical source separation using the fundamental frequency contour of each of the singing groups and demonstrate that our proposed approach surpasses results from domain-agnostic architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑