面向语音合成鲁棒协同水印的音频编解码器增强
Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis
AI总结：
本文扩展协同水印方法以应对不可微的传统与神经音频编解码器，利用波形域直通估计器实现黑盒增强，证明该方法对传统编解码器具良好迁移性且感知退化可忽略。
摘要：
随着当前合成方法与人类语音近乎难以区分且被公众广泛获取，自动检测合成语音变得日益重要。音频水印和其他主动披露方法正引起研究关注，因为它们可以补充基于被动检测的传统深度伪造防御。在主动和被动检测中，鲁棒性都是主要关注点。传统音频水印特别容易受到音频编解码器应用的移除攻击。大多数发布到野外的生成语音和音频内容纯粹作为分发方式通过音频编解码器。我们最近提出了协同水印作为一种方法，用于使生成的语音在嘈杂但可微的传输信道上更容易被检测到。本文将信道增强扩展到适用于不可微的传统音频编解码器和神经音频编解码器，并评估了在各种配置下的可迁移性和编解码器比特率的影响。结果表明，使用波形域直通估计器进行梯度近似，协同水印可以通过黑盒音频编解码器可靠地增强。此外，结果表明，使用神经音频编解码器的信道增强可以很好地迁移到传统编解码器。听音测试表明，协同水印在使用高比特率编解码器或 8kbps 的 DAC 时会产生可忽略不计的感知退化。
英文摘要：
Automatic detection of synthetic speech is becoming increasingly important as current synthesis methods are both near indistinguishable from human speech and widely accessible to the public. Audio watermarking and other active disclosure methods of are attracting research activity, as they can complement traditional deepfake defenses based on passive detection. In both active and passive detection, robustness is of major interest. Traditional audio watermarks are particularly susceptible to removal attacks by audio codec application. Most generated speech and audio content released into the wild passes through an audio codec purely as a distribution method. We recently proposed collaborative watermarking as method for making generated speech more easily detectable over a noisy but differentiable transmission channel. This paper extends the channel augmentation to work with non-differentiable traditional audio codecs and neural audio codecs and evaluates transferability and effect of codec bitrate over various configurations. The results show that collaborative watermarking can be reliably augmented by black-box audio codecs using a waveform-domain straight-through-estimator for gradient approximation. Furthermore, that results show that channel augmentation with a neural audio codec transfers well to traditional codecs. Listening tests demonstrate collaborative watermarking incurs negligible perceptual degradation with high bitrate codecs or DAC at 8kbps.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
