In this work, we examine the problem of efficiently preprocessing high volume bird acoustic data. We combine several existing preprocessing steps including noise reduction approaches into a single efficient pipeline by examining each process individually. We then utilise a distributed computing architecture to improve execution time. Using a master-slave model with data parallelisation, we developed a near-linear automated scalable system, capable of preprocessing bird acoustic recordings 21.76 times faster with 32 cores over 8 virtual machines, compared to a serial process. This work contributes to the research area of bioacoustic analysis, which is currently very active because of its potential to monitor animals quickly at low cost. Overcoming noise interference is a significant challenge in many bioacoustic studies, and the volume of data in these studies is increasing. Our work makes large scale bird acoustic analyses more feasible by parallelising important bird acoustic processing tasks to significantly reduce execution times.
MyGardenBird: A Machine-Learning-Ready Bird Sound Dataset for Twelve Common Malaysian Birds
Faculty of Computer Science and Information Technology, Universiti Malaya(马来大学计算机科学与信息技术学院);Faculty of Electrical Engineering, Universiti Teknologi Malaysia(技术学院电气工程学院)
Western Mediterranean wetlands bird species classification: evaluating small-footprint deep learning approaches on a new annotated dataset
La Salle-Universitat Ramon Llull(拉蒙·柳利大学拉萨尔学院)
部署一个运行在无线声学传感器网络上的专家系统,该网络由生物声学监测设备组成,可以从声音中识别鸟类,这将使许多具有生态价值的任务实现自动化,包括分析鸟类种群组成或检测环境利益领域的濒危物种。得益于人工智能的最新进展,赋予这些设备准确的音频分类功能是可能的,其中深度学习技术表现出色。然而,使生物声学设备负担得起的一个关键问题是使用可以嵌入在资源和电池受限的硬件平台中的小足迹深度神经网络。出于这个原因,这项工作提出了两个重型和大型足迹深度神经网络(VGG 16和ResNet 50)和轻量级替代方案MobileNetV2之间的关键比较分析。我们的实验结果表明,MobileNetV2的平均F1分数比ResNet50低不到5%(0.789 vs. 0.834),表现优于VGG16,占用空间小近40倍。此外,为了比较模型,我们创建并公开了西地中海湿地鸟类数据集,包括201.6分钟和5,795个Aiguamolls de l'Empordà自然公园20种特有鸟类的音频摘录。
Time-frequency localization of bird calls in dense soundscapes
Acoustic Research Laboratory, National University of Singapore(新加坡国立大学声学研究实验室);Tropical Marine Science Institute, National University of Singapore(新加坡国立大学热带海洋科学研究所);School of Marine Science and Technology, Northwestern Polytechnical University(西北工业大学航海学院)
Leveraging tropical reef, bird and unrelated sounds for superior transfer learning in marine bioacoustics
University College London(伦敦大学学院);Google DeepMind(谷歌DeepMind);Zoological Society of London(伦敦动物学会);Conservation Metrics Inc.(保护指标公司);University of New Hampshire(新罕布什尔大学);K. Lisa Yang Center for Conservation Bioacoustics, Cornell Lab of Ornithology, Cornell University(康奈尔大学鸟类学实验室K. Lisa Yang保护生物声学中心);Department of Public and Ecosystem Health, Cornell University(康奈尔大学公共与生态系统健康系);Sound Ocean Science(海洋声学科学);University of Exeter(埃克塞特大学);University of Bristol(布里斯托大学);IPB University(IPB大学);Google Research(谷歌研究院)
Uncertainty Calibration of Multi-Label Bird Sound Classifiers
INS, Kiel University, Germany(基尔大学);Tilburg University, Netherlands(蒂尔堡大学);Naturalis Biodiversity Center, Netherlands(自然史生物多样性中心);IES, University of Kassel, Germany(卡塞尔大学)
Explainability of CNN Based Classification Models for Acoustic Signal
Department of Computer Science, Missouri State University(计算机科学系,密苏里州立大学);Department of Biology, Missouri State University(生物学系,密苏里州立大学);Biodiversity Research Institute(生物多样性研究学院)
Robust sound event detection in bioacoustic sensor networks
Cornell Lab of Ornithology, Cornell University(康奈尔大学康奈尔鸟类学实验室);Music and Audio Research Laboratory, New York University(纽约大学音乐与音频研究实验室);Center for Urban Science and Progress, New York University(纽约大学城市科学与进步中心)
Acoustic Scene Classification Using Bilinear Pooling on Time-liked and Frequency-liked Convolution Neural Network
Xylem Inc(赛莱默公司);Newcastle University(纽卡斯尔大学)
当前处理声学场景分类(ASC)任务的方法可以描述为两个步骤,将音频波形预处理成对数梅尔频谱图,然后将其用作卷积神经网络(CNN)的输入表示。这种范式转变发生在DCASE 2016之后,该框架模型在(ESC-50)数据集上实现了ASC任务的最新结果,并实现了64.5%的准确度,比基线模型提高了20.5%,DCASE 2016数据集的准确度为90.0%(开发)和86.2%(评估),分别比基线系统提高了6.4%和9%。本文探讨了利用谐波和谐波源分离(HPSS)将音频分离为谐波音频和谐波音频的方法,该方法在音乐信息检索(MIR)领域得到了广泛的应用。虽然已经在ASC任务中使用HPSS作为CNN模型的输入表示方面做了工作,但是本文进一步研究了通过策展2个CNN来利用分离的谐波分量和谐波分量的可能性,所述2个CNN试图以其自然形式理解谐波音频和谐波音频,一个专门用于在时间偏置域中提取深度特征,另一个专门用于在频率偏置域中提取深度特征,分别然后,从这2个CNN中提取的深度特征将使用双线性池进行组合。因此,提出了一种时频双流CNN结构的声学场景分类方法。该模型正在DCASE 2019子任务1a数据集上进行评估,并在开发数据集Kaggle Leadership Private and Public Board上平均得分为65%。
2-Dimensional spectral gating for denoising bioacoustics recordings
Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Pioneer Centre for AI, University of Copenhagen(哥本哈根大学人工智能先锋中心);McGill University(麦吉尔大学);Stockholm University(斯德哥尔摩大学)