通过令牌操作保护分类器中的隐私
Protecting Privacy in Classifiers by Token Manipulation
AI总结:
本文研究在文本分类任务中通过令牌映射和上下文化操作隐藏原始文本以保护隐私,发现简单映射损害性能且可被重建,而上下文化操作性能更优。
摘要:
将语言模型用作远程服务需要将私人信息发送给不可信的提供商。此外,潜在的窃听者可以截获消息,从而暴露信息。在这项工作中,我们探讨了在文本操作层面避免此类数据暴露的前景。我们专注于文本分类模型,考察各种令牌映射和上下文化操作函数,以观察在保持原始文本不可恢复的同时,分类器精度是否可以得到维持。我们发现,尽管某些令牌映射函数易于直接实现,但它们严重影响下游任务的性能,并且通过复杂的攻击者可以被重建。相比之下,上下文化操作在性能上提供了改进。
英文摘要:
Using language models as a remote service entails sending private information to an untrusted provider. In addition, potential eavesdroppers can intercept the messages, thereby exposing the information. In this work, we explore the prospects of avoiding such data exposure at the level of text manipulation. We focus on text classification models, examining various token mapping and contextualized manipulation functions in order to see whether classifier accuracy may be maintained while keeping the original text unrecoverable. We find that although some token mapping functions are easy and straightforward to implement, they heavily influence performance on the downstream task, and via a sophisticated attacker can be reconstructed. In comparison, the contextualized manipulation provides an improvement in performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。