山之声:基于深度学习的库尔德马卡姆唱错检测系统
Voices of the Mountains: Deep Learning-Based Vocal Error Detection System for Kurdish Maqams
AI总结:
本研究提出一种基于深度学习的库尔德马卡姆唱错检测系统,通过双头CNN-BiLSTM模型识别音高、节奏和模态稳定性错误,验证集宏F1为0.468,但模态漂移召回率较低,需更多数据和平衡。
摘要:
马卡姆是一种歌唱类型,是库尔德音乐的重要组成部分。马卡姆歌手通过传统的面对面教学或自我训练进行训练。自动歌唱评估(ASA)利用机器学习(ML)来提供歌唱风格的准确性,并可通过错误检测帮助学习者提高表现。目前,可用的ASA工具遵循西方音乐规则。音乐创作要求所有音符在整个过程中都保持在预期的音高范围内。系统无法检测微音程和音高弯曲,因此将库尔德马卡姆演唱视为错误,尽管歌手是按照传统规则进行表演的。库尔德马卡姆需要在微音阶空间内识别表演错误,这超出了西方等 temperament。本研究是首次尝试解决上述缺口。尽管许多错误类型发生在演唱过程中,我们的重点是在贝亚蒂-库尔德语境下的音高、节奏和模态稳定性错误。我们收集了13位歌手的50首歌曲(2-3小时),并标注了221个错误片段(150个细音高、46个节奏、25个模态漂移)。数据被分割成15,199个重叠窗口,并转换为对数梅尔频谱图。我们开发了一个双头CNN-BiLSTM加注意机制,以决定窗口是否包含错误,并根据所选错误进行分类。在20个epoch训练中,早停在第10个epoch,模型在验证集上的宏F1为0.468。在完整的50首歌曲评估中,阈值为0.750时,召回率为39.4%,精确率为25.8%。在检测到的窗口中,类型宏F1为0.387,其中细音高F1为0.492,节奏F1为0.536,模态漂移F1为0.133;模态漂移召回率为8.0%。在常见错误类型上的更好表现表明该方法有效,而模态漂移召回率差表明需要更多数据和平衡。
英文摘要:
Maqam, a singing type, is a significant component of Kurdish music. A maqam singer receives training in a traditional face-to-face or through self-training. Automatic Singing Assessment (ASA) uses machine learning (ML) to provide the accuracy of singing styles and can help learners to improve their performance through error detection. Currently, the available ASA tools follow Western music rules. The musical composition requires all notes to stay within their expected pitch range from start to finish. The system fails to detect micro-intervals and pitch bends, so it identifies Kurdish maqam singing as incorrect even though the singer performs according to traditional rules. Kurdish maqam requires recognizing performance errors within microtonal spaces, which is beyond Western equal temperament. This research is the first attempt to address the mentioned gap. While many error types happen during singing, our focus is on pitch, rhythm, and modal stability errors in the context of Bayati-Kurd. We collected 50 songs from 13 vocalists ( 2-3 hours) and annotated 221 error spans (150 fine pitch, 46 rhythm, 25 modal drift). The data was segmented into 15,199 overlapping windows and converted to log-mel spectrograms. We developed a two-headed CNN-BiLSTM with attention mode to decide whether a window contains an error and to classify it based on the chosen errors. Trained for 20 epochs with early stopping at epoch 10, the model reached a validation macro-F1 of 0.468. On the full 50-song evaluation at a 0.750 threshold, recall was 39.4% and precision 25.8% . Within detected windows, type macro-F1 was 0.387, with F1 of 0.492 (fine pitch), 0.536 (rhythm), and 0.133 (modal drift); modal drift recall was 8.0%. The better performance on common error types shows that the method works, while the poor modal-drift recall shows that more data and balancing are needed.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。