鲁棒的有损音频压缩识别
Robust Lossy Audio Compression Identification
AI总结:
本文揭示有损音频压缩识别模型对未见编解码器参数缺乏鲁棒性,并提出随机掩码频谱图的训练策略以显著提升模型泛化能力。
摘要:
以往关于盲有损压缩识别的研究在其测试集上报告了近乎完美的性能指标,涵盖多种编解码器和比特率。然而,我们表明这类结果可能具有欺骗性,未必能准确反映系统处理当前任务的实际能力。本文对有损音频识别模型的鲁棒性和泛化能力进行了研究。我们的贡献如下:(1)我们展示了与现有技术相当的模型对编解码器参数变化缺乏鲁棒性。具体而言,当在一个由多种编解码器及其无损对应版本处理的音乐录音数据集上朴素地训练有损压缩检测模型时,我们在留出测试集上获得了近乎完美的性能指标,但在使用训练中未见的编解码器参数生成的有损音轨上性能严重下降。(2)我们提出并展示了一种改进训练策略的有效性,该策略能显著提升模型在训练期间未见过的编解码器配置之外的鲁棒性和泛化能力。即我们对输入频谱图施加随机掩码,以促使模型不要仅仅依赖训练集的编解码器截止频率。
英文摘要:
Previous research contributions on blind lossy compression identification report near perfect performance metrics on their test set, across a variety of codecs and bit rates. However, we show that such results can be deceptive and may not accurately represent true ability of the system to tackle the task at hand. In this article, we present an investigation into the robustness and generalisation capability of a lossy audio identification model. Our contributions are as follows. (1) We show the lack of robustness to codec parameter variations of a model equivalent to prior art. In particular, when naively training a lossy compression detection model on a dataset of music recordings processed with a range of codecs and their lossless counterparts, we obtain near perfect performance metrics on the held-out test set, but severely degraded performance on lossy tracks produced with codec parameters not seen in training. (2) We propose and show the effectiveness of an improved training strategy to significantly increase the robustness and generalisation capability of the model beyond codec configurations seen during training. Namely we apply a random mask to the input spectrogram to encourage the model not to rely solely on the training set's codec cutoff frequency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。