All Thresholds Barred: Direct Estimation of Call Density in Bioacoustic Data
Oregon State University(俄勒冈州立大学);Google Research(谷歌研究院)
Amanda K. Navine, Tom Denton, Matthew J. Weldy, Patrick J. Hart
备注:
14 pages, 6 figures, 3 tables; submitted to Frontiers in Bird Science; Our Hawaiian PAM dataset and classifier scores, as well as annotation information for the three study species, can be found on Zenodo at https://doi.org/10.5281/zenodo.10581530. The fully annotated Powdermill dataset assembled by Chronister et al. that was used in this study is available at https://doi.org/10.1002/ecy.3329
Passive acoustic monitoring (PAM) studies generate thousands of hours of audio, which may be used to monitor specific animal populations, conduct broad biodiversity surveys, detect threats such as poachers, and more. Machine learning classifiers for species identification are increasingly being used to process the vast amount of audio generated by bioacoustic surveys, expediting analysis and increasing the utility of PAM as a management tool. In common practice, a threshold is applied to classifier output scores, and scores above the threshold are aggregated into a detection count. The choice of threshold produces biased counts of vocalizations, which are subject to false positive/negative rates that may vary across subsets of the dataset. In this work, we advocate for directly estimating call density: The proportion of detection windows containing the target vocalization, regardless of classifier score. Our approach targets a desirable ecological estimator and provides a more rigorous grounding for identifying the core problems caused by distribution shifts -- when the defining characteristics of the data distribution change -- and designing strategies to mitigate them. We propose a validation scheme for estimating call density in a body of data and obtain, through Bayesian reasoning, probability distributions of confidence scores for both the positive and negative classes. We use these distributions to predict site-level densities, which may be subject to distribution shifts. We test our proposed methods on a real-world study of Hawaiian birds and provide simulation results leveraging existing fully annotated datasets, demonstrating robustness to variations in call density and classifier model quality.
Classifying bioacoustic data without individual call annotations using temporal convolutional networks and feature extractors
Sea Mammal Research Unit, School of Biology, University of St. Andrews(海洋哺乳动物研究单位,生物学系,圣安德鲁大学);Electrical and Electronic Engineering, University of Strathclyde(电子与电气工程,斯特拉斯克莱德大学)
RAVEN X High Performance Data Mining Toolbox for Bioacoustic Data Analysis
Bioacoustics Research Program, Cornell Lab of Ornithology, Cornell University(康奈尔大学鸟类学实验室生物声学研究项目);Department of Computer Science, San Diego State University(圣地亚哥州立大学计算机科学系);US Navy, SPAWAR Systems Center Pacific(美国海军太平洋空间与海战系统中心)
Lightweight Hopfield Neural Networks for Bioacoustic Detection and Call Monitoring of Captive Primates
School of Engineering, Computing and Mathematical Sciences(工程、计算与数学科学学院);School of Pharmacy and Life Sciences(药学与生命科学学院);University of Wolverhampton(沃里克大学)
Robust sound event detection in bioacoustic sensor networks
Cornell Lab of Ornithology, Cornell University(康奈尔大学康奈尔鸟类学实验室);Music and Audio Research Laboratory, New York University(纽约大学音乐与音频研究实验室);Center for Urban Science and Progress, New York University(纽约大学城市科学与进步中心)
Whombat: An open-source annotation tool for machine learning development in bioacoustics
University College London(伦敦大学学院);University of Edinburgh(爱丁堡大学);Oregon State University(俄勒冈州立大学);USDA Forest Service(美国农业部林务局);Bat Conservation Trust(蝙蝠保护信托基金)
Multi-Representation Attention Framework for Underwater Bioacoustic Denoising and Recognition
MILA – Quebec AI Institute(魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Université du Québec à Rimouski(里莫斯基大学);ISMER(ISMER机构);Institut Polytechnique de Paris(巴黎高等理工学院)
Detection and Classification of Cetacean Echolocation Clicks using Image-based Object Detection Methods applied to Advanced Wavelet-based Transformations
Balancing physical modeling and musical requirements: Algorithmically simulating the calls of Hyalessa maculaticollis for real-time instrumental control
Learning to detect an animal sound from five examples
Queen Mary University of London(伦敦玛丽女王大学);Nantes Universite, Ecole Centrale Nantes, CNRS, LS2N, UMR 6004(南特大学,南特中央理工大学,法国国家科学研究中心,LS2N,UMR 6004);University of Konstanz(康斯坦茨大学);Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所);Universitat Ramon Llull(拉蒙·尤以大学);BIOTOPIA Naturkundemuseum Bayern(巴伐利亚州自然博物馆BIOTOPIA);AGH University of Science and Technology(AGH科技大学);University of Salford(索尔福德大学);University of Surrey(萨里大学);Aarhus University(奥胡斯大学);Syracuse University(雪城大学);Woods Hole Oceanographic Institution(伍兹霍尔海洋研究所)
Time-frequency localization of bird calls in dense soundscapes
Acoustic Research Laboratory, National University of Singapore(新加坡国立大学声学研究实验室);Tropical Marine Science Institute, National University of Singapore(新加坡国立大学热带海洋科学研究所);School of Marine Science and Technology, Northwestern Polytechnical University(西北工业大学航海学院)