arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.07408cs.SDeess.AS
收藏

STONE:自监督调性估计器

STONE: Self-supervised Tonality Estimator

Deezer Research(Deezer研究院);Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);LS2N(南特数字科学实验室)

Yuexuan Kong, Vincent Lostanlen, Gabriel Meseguer-Brocal, Stella Wong, Mathieu Lagrange, Romain Hennequin

AI总结:

提出首个自监督调性估计器STONE,通过ChromaNet架构预测音高移位,在减少监督时达到全监督模型准确率,并在同等监督下超越全监督模型。

摘要:

尽管深度神经网络能够估计乐曲的调性,但其监督过程需要大量的标注工作。针对这一缺陷,我们提出了STONE,这是首个自监督调性估计器。STONE背后的架构名为ChromaNet,是一个具有八度等价性的卷积网络,可输出由12个结构化logits组成的调号轮廓(KSP)。首先,我们训练ChromaNet来回归同一音频片段中任意两段未标注音乐摘录之间的人工音高移位,该移位通过五度圈(CoF)内的互功率谱密度(CPSD)来度量。我们观察到,这一自监督前置任务使得KSP能够与调性调号相关联。基于此观察,我们将STONE扩展为输出包含24个logits的结构化KSP,并引入监督以消歧共享同一调号的大调与小调。施加不同程度的监督可得到半监督和全监督的调性估计器:即Semi-TONEs和Sup-TONEs。我们在FMAK上评估了这些估计器,FMAK是一个包含5489段真实世界音乐录音的新数据集,带有24个大调和小调的专家标注。我们发现,Semi-TONE在减少监督时达到了Sup-TONE的分类准确率,并且在同等监督下超越了它。

英文摘要:

Although deep neural networks can estimate the key of a musical piece, their supervision incurs a massive annotation effort. Against this shortcoming, we present STONE, the first self-supervised tonality estimator. The architecture behind STONE, named ChromaNet, is a convnet with octave equivalence which outputs a key signature profile (KSP) of 12 structured logits. First, we train ChromaNet to regress artificial pitch transpositions between any two unlabeled musical excerpts from the same audio track, as measured as cross-power spectral density (CPSD) within the circle of fifths (CoF). We observe that this self-supervised pretext task leads KSP to correlate with tonal key signature. Based on this observation, we extend STONE to output a structured KSP of 24 logits, and introduce supervision so as to disambiguate major versus minor keys sharing the same key signature. Applying different amounts of supervision yields semi-supervised and fully supervised tonality estimators: i.e., Semi-TONEs and Sup-TONEs. We evaluate these estimators on FMAK, a new dataset of 5489 real-world musical recordings with expert annotation of 24 major and minor keys. We find that Semi-TONE matches the classification accuracy of Sup-TONE with reduced supervision and outperforms it with equal supervision.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑