arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.07560cs.LGcs.SDeess.AS
收藏

无监督分类提高鸟鸣记录数据集的质量

Unsupervised classification to improve the quality of a bird song recording dataset

Institut Systématique, Évolution, Biodiversité (ISYEB), Muséum national d’Histoire naturelle, CNRS, Sorbonne Université, EPHE, Université des Antilles(系统学、进化与生物多样性研究所(ISYEB),法国国家自然历史博物馆,法国国家科学研究中心,索邦大学,巴黎高等研究实践学院,安第列斯大学)

Félix Michaud, Jérôme Sueur, Maxime Le Cesne, Sylvain Haupert

摘要:

Xeno-Canto等开放式音频数据库被广泛用于构建数据集,以探索鸟类的鸣叫曲目,或通过深度学习算法来训练用于自动鸟类声音分类的模型。然而,这样的数据库遭受的事实,鸟类的声音是弱标记:一个物种的名称是归因于每个音频记录没有时间戳,提供了时间定位感兴趣的鸟鸣。手动注释可以解决这个问题,但它们非常耗时,依赖于专家,并且无法在大型数据集上运行。另一种解决方案包括使用标记功能,该标记功能在将标签分配给每个分段的音频样本之前自动地对音频记录进行分段。虽然引入了标签功能以加快强标签分配,但其分类性能仍然是未知的。为了解决这个问题,并减少标签噪声(错误的标签分配)在大型鸟鸣数据集,我们引入了一个以数据为中心的新的标签功能,包括三个连续的步骤:1)时频声音单元分割,2)每个声音单元的特征计算,和3)每个声音单元的分类鸟鸣或噪声与无监督DBSCAN算法或监督BirdNET神经网络。标记功能进行了优化,验证,并测试了44个西方古北常见鸟类的歌曲。我们首先表明,根据物种的不同,仅对鸟鸣的分割就聚集了10%到83%的标签噪声。我们还证明了我们的标签函数能够将数据集中存在的初始标签噪声显著降低高达三倍。最后,我们讨论了不同的机会来设计合适的标签功能,以建立高质量的动物发声与最小的专家注释工作。

英文摘要:

Open audio databases such as Xeno-Canto are widely used to build datasets to explore bird song repertoire or to train models for automatic bird sound classification by deep learning algorithms. However, such databases suffer from the fact that bird sounds are weakly labelled: a species name is attributed to each audio recording without timestamps that provide the temporal localization of the bird song of interest. Manual annotations can solve this issue, but they are time consuming, expert-dependent, and cannot run on large datasets. Another solution consists in using a labelling function that automatically segments audio recordings before assigning a label to each segmented audio sample. Although labelling functions were introduced to expedite strong label assignment, their classification performance remains mostly unknown. To address this issue and reduce label noise (wrong label assignment) in large bird song datasets, we introduce a data-centric novel labelling function composed of three successive steps: 1) time-frequency sound unit segmentation, 2) feature computation for each sound unit, and 3) classification of each sound unit as bird song or noise with either an unsupervised DBSCAN algorithm or the supervised BirdNET neural network. The labelling function was optimized, validated, and tested on the songs of 44 West-Palearctic common bird species. We first showed that the segmentation of bird songs alone aggregated from 10% to 83% of label noise depending on the species. We also demonstrated that our labelling function was able to significantly reduce the initial label noise present in the dataset by up to a factor of three. Finally, we discuss different opportunities to design suitable labelling functions to build high-quality animal vocalizations with minimum expert annotation effort.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑