ReTokSync:自同步的令牌化歧义消除用于生成式语言隐写术
ReTokSync: Self-Synchronizing Tokenization Disambiguation for Generative Linguistic Steganography
AI总结:
ReTokSync通过自同步机制解决生成式语言隐写术中令牌化歧义问题,保持分布安全性和文本质量,实现高提取准确率和高效运行。
摘要:
生成式语言隐写术(GLS)通过在自然语言生成过程中嵌入秘密信息实现隐秘通信。然而,在实际部署中,GLS容易受到令牌化歧义的影响:接收方可能将相同表面文本重新令牌化为不同的令牌序列,破坏通信双方共享的解码状态,导致单个局部不匹配可能引发完全提取失败。现有解决方案要么移除歧义令牌,破坏生成分布并影响安全性,要么保留分布但牺牲显著的嵌入容量或产生不可接受的运行时间开销。为了解决这一问题,我们提出了ReTokSync(Re-Tokenization Synchronization),一种自同步的歧义消除框架,它在生成过程中监控接收方视角的令牌化,并仅在实际发生歧义时触发纠正重置。通过将令牌化歧义的影响限制在稀疏残差位错误而非全局不同步,ReTokSync完全保留歧义自由位置,并与底层隐写术算法保持兼容。在英语和中文设置上的实验表明,ReTokSync在分布安全性(零KL散度)、文本质量、嵌入容量和运行时间方面最接近隐写术基线,同时实现提取准确率超过99.7%。基于这一特性,我们进一步开发了一种双通道隐秘通信机制,其中ReTokSync作为主要通道,一个可靠的辅助通道纠正剩余错误,实现所有评估配置下的100%端到端恢复。
英文摘要:
Generative linguistic steganography (GLS) enables covert communication by embedding secret messages into the natural language generation process. In practical deployment, however, GLS is vulnerable to tokenization ambiguity: the same surface text may be re-tokenized into a different token sequence at the receiver, breaking the shared decoding state between the communicating parties so that a single local mismatch can propagate into complete extraction failure. Existing solutions either remove ambiguous tokens -- distorting the generation distribution and compromising security -- or preserve the distribution at the cost of substantially reduced embedding capacity or prohibitive runtime overhead. To address this issue, we propose ReTokSync (Re-Tokenization Synchronization), a self-synchronizing disambiguation framework that monitors the receiver-view tokenization during generation and triggers a corrective reset only when ambiguity actually occurs. By confining the effect of tokenization ambiguity to sparse residual bit errors rather than global desynchronization, ReTokSync leaves ambiguity-free positions entirely untouched and remains compatible with the underlying steganographic algorithm. Experiments on both English and Chinese settings show that ReTokSync stays closest to the steganographic baseline in distributional security (zero KL divergence), text quality, embedding capacity, and runtime, while achieving extraction accuracy above 99.7\%. Building on this property, we further develop a two-channel covert communication mechanism in which ReTokSync serves as the primary channel and a reliable auxiliary channel corrects the remaining errors, achieving 100\% end-to-end recovery across all evaluated configurations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。