TraceableSpeech:通过水印技术迈向可主动追踪的文本转语音
TraceableSpeech: Towards Proactively Traceable Text-to-Speech with Watermarking
AI总结:
提出TraceableSpeech,一种直接生成带水印语音的新型TTS模型,通过逐帧水印嵌入与提取,提升了语音质量、水印不可感知性、对重拼攻击的鲁棒性及时间灵活性。
摘要:
文本转语音(TTS)的进步带来了各种威胁,促使需要可靠地追踪合成的语音。然而,当前该任务的方法是在音频生成后单独添加水印,这一过程会损害语音质量和水印的不可感知性。此外,这些方法在鲁棒性和灵活性方面也受到限制。为了解决这些问题,我们提出了TraceableSpeech,一种直接生成带水印语音的新型TTS模型,提升了水印的不可感知性和语音质量。此外,我们设计了逐帧的水印嵌入与提取,实现了对重拼攻击的更强鲁棒性和操作上的时间灵活性。实验结果表明,TraceableSpeech在水印不可感知性、语音质量和对重拼攻击的抵御能力上,均优于VALL-E或HiFicodec单独使用WavMark的强基线。它也适用于不同时长的语音。代码可在https://github.com/zjzser/TraceableSpeech获取。
英文摘要:
Various threats posed by the progress in text-to-speech (TTS) have prompted the need to reliably trace synthesized speech. However, contemporary approaches to this task involve adding watermarks to the audio separately after generation, a process that hurts both speech quality and watermark imperceptibility. In addition, these approaches are limited in robustness and flexibility. To address these problems, we propose TraceableSpeech, a novel TTS model that directly generates watermarked speech, improving watermark imperceptibility and speech quality. Furthermore, We design the frame-wise imprinting and extraction of watermarks, achieving higher robustness against resplicing attacks and temporal flexibility in operation. Experimental results show that TraceableSpeech outperforms the strong baseline where VALL-E or HiFicodec individually uses WavMark in watermark imperceptibility, speech quality and resilience against resplicing attacks. It also can apply to speech of various durations. The code is avaliable at https://github.com/zjzser/TraceableSpeech
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。