arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.00535cs.DCcs.SDeess.AS
收藏

大容量鸟声数据的可扩展预处理

Scalable Preprocessing of High Volume Bird Acoustic Data

University of Tasmania(塔斯马尼亚大学)

Alexander Brown, Saurabh Garg, James Montgomery

摘要:

在这项工作中,我们研究的问题,有效地预处理大量的鸟类声学数据。我们结合了几个现有的预处理步骤,包括降噪方法到一个单一的有效的管道,通过单独检查每个过程。然后,我们利用一个分布式计算架构,以提高执行时间。使用具有数据并行化的主从模型,我们开发了一个接近线性的自动化可扩展系统,与串行过程相比,能够在8个虚拟机上使用32个核心以21.76倍的速度预处理鸟类声学记录。这项工作有助于生物声学分析的研究领域,这是目前非常活跃,因为它的潜力,以低成本快速监测动物。克服噪声干扰是许多生物声学研究中的一个重大挑战,并且这些研究中的数据量正在增加。我们的工作使大规模的鸟类声学分析更可行的并行重要的鸟类声学处理任务,以显着减少执行时间。

英文摘要:

In this work, we examine the problem of efficiently preprocessing high volume bird acoustic data. We combine several existing preprocessing steps including noise reduction approaches into a single efficient pipeline by examining each process individually. We then utilise a distributed computing architecture to improve execution time. Using a master-slave model with data parallelisation, we developed a near-linear automated scalable system, capable of preprocessing bird acoustic recordings 21.76 times faster with 32 cores over 8 virtual machines, compared to a serial process. This work contributes to the research area of bioacoustic analysis, which is currently very active because of its potential to monitor animals quickly at low cost. Overcoming noise interference is a significant challenge in many bioacoustic studies, and the volume of data in these studies is increasing. Our work makes large scale bird acoustic analyses more feasible by parallelising important bird acoustic processing tasks to significantly reduce execution times.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑