学习阶段式 GAN 用于时频谱图中的哨声提取
Learning Stage-wise GANs for Whistle Extraction in Time-Frequency Spectrograms
AI总结:
提出阶段式 GAN 框架分阶段生成背景噪声、哨声轮廓和信号以合成训练数据,解决标注稀缺问题,显著提升哨声提取模型性能。
摘要:
哨声轮廓提取旨在从时频谱图中将动物哨声提取为折线。对于齿鲸,哨声提取结果可作为分析动物数量、物种身份和社会活动的基础。在过去几十年中,随着长期录音系统变得可负担,自动化哨声提取算法被提出以处理大量录音数据。近期,一种基于深度学习的方法在变化噪声条件下提取哨声方面展现出卓越性能。然而,训练此类网络需要大量劳动密集型标注,而这对于许多物种而言是缺乏的。为克服此限制,我们提出了一种阶段式生成对抗网络(GANs)框架,通过三个阶段编译适合深度模型训练的新哨声数据:谱图中背景噪声的生成、哨声轮廓的生成以及哨声信号的生成。通过分离样本中不同组件的生成,我们的框架即使在仅有少量专家标注数据时也能合成视觉上逼真的哨声数据和标签。无论人工标注数据量多少,所提出的数据增强框架均能带来哨声提取模型性能的持续提升,哨声提取平均 F1 分数最大提升 1.69。我们的阶段式 GAN 在利用增强数据改进哨声提取模型方面也优于单一 GAN。数据和代码将发布于 https://github.com/Paul-LiPu/CompositeGAN_WhistleAugment。
英文摘要:
Whistle contour extraction aims to derive animal whistles from time-frequency spectrograms as polylines. For toothed whales, whistle extraction results can serve as the basis for analyzing animal abundance, species identity, and social activities. During the last few decades, as long-term recording systems have become affordable, automated whistle extraction algorithms were proposed to process large volumes of recording data. Recently, a deep learning-based method demonstrated superior performance in extracting whistles under varying noise conditions. However, training such networks requires a large amount of labor-intensive annotation, which is not available for many species. To overcome this limitation, we present a framework of stage-wise generative adversarial networks (GANs), which compile new whistle data suitable for deep model training via three stages: generation of background noise in the spectrogram, generation of whistle contours, and generation of whistle signals. By separating the generation of different components in the samples, our framework composes visually promising whistle data and labels even when few expert annotated data are available. Regardless of the amount of human-annotated data, the proposed data augmentation framework leads to a consistent improvement in performance of the whistle extraction model, with a maximum increase of 1.69 in the whistle extraction mean F1-score. Our stage-wise GAN also surpasses one single GAN in improving whistle extraction models with augmented data. The data and code will be available at https://github.com/Paul-LiPu/CompositeGAN\_WhistleAugment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。