S-KEY:从音频中自监督学习大调与小调
S-KEY: Self-supervised Learning of Major and Minor Keys from Audio
AI总结:
本文提出S-KEY,通过扩展STONE架构并引入基于移调不变色度特征的辅助任务,实现无需标注的大调与小调自监督识别,性能媲美监督方法,并扩展至百万歌曲训练。
摘要:
STONE是当前用于音乐信号调性估计的自监督学习方法,但它无法区分关系大小调,例如C大调与A小调。在本文中,我们扩展了STONE的神经网络架构和学习目标,以执行大调与小调的自监督学习(S-KEY)。我们的主要贡献是为STONE增加一个辅助 pretext 任务,该任务利用移调不变色度特征作为伪标签来源。S-KEY在FMAKv2和GTZAN数据集上的调性估计性能与有监督的最先进方法相当,同时无需任何人工标注,且参数预算与STONE相同。我们在此结果基础上,将S-KEY的训练集扩展到一百万首歌曲,从而展示了大规模自监督学习在音乐信息检索中的潜力。
英文摘要:
STONE, the current method in self-supervised learning for tonality estimation in music signals, cannot distinguish relative keys, such as C major versus A minor. In this article, we extend the neural network architecture and learning objective of STONE to perform self-supervised learning of major and minor keys (S-KEY). Our main contribution is an auxiliary pretext task to STONE, formulated using transposition-invariant chroma features as a source of pseudo-labels. S-KEY matches the supervised state of the art in tonality estimation on FMAKv2 and GTZAN datasets while requiring no human annotation and having the same parameter budget as STONE. We build upon this result and expand the training set of S-KEY to a million songs, thus showing the potential of large-scale self-supervised learning in music information retrieval.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。