arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.00751cs.CL
收藏

跳出差分隐私的思维定式:基于语言模型提示的文本隐私化案例研究

Thinking Outside of the Differential Privacy Box: A Case Study in Text Privatization with Language Model Prompting

Technical University of Munich(慕尼黑工业大学);School of Computation, Information and Technology(计算、信息与技术学院)

Stephen Meisenbacher, Florian Matthes

AI总结:

本文以DP-Prompt为案例,通过多场景重写实验和效用与隐私评估,批判性审视差分隐私在NLP中的限制,呼吁重新讨论其可用性与相对优势。

摘要:

隐私保护自然语言处理领域日益受到关注,尤其是在大型语言模型普及引发隐私担忧加剧的背景下。近期文献中反复出现的一种解决方案是将差分隐私(DP)集成到自然语言处理技术中。本文对这些方法进行批判性审视,讨论差分隐私集成所带来的限制,并揭示这些限制所引发的挑战。为此,我们聚焦于$\ extbf{DP-Prompt}$,这是一种近期提出的利用语言模型重写文本来实现文本隐私化的方法。具体而言,我们在多个场景中探索这一重写任务,既包括使用差分隐私的情况,也包括不使用差分隐私的情况。为推动关于差分隐私在自然语言处理中价值的讨论,我们进行了实证效用和隐私实验。我们的结果表明,有必要就差分隐私在自然语言处理中的可用性及其相对于非差分隐私方法的优势展开更多讨论。

英文摘要:

The field of privacy-preserving Natural Language Processing has risen in popularity, particularly at a time when concerns about privacy grow with the proliferation of Large Language Models. One solution consistently appearing in recent literature has been the integration of Differential Privacy (DP) into NLP techniques. In this paper, we take these approaches into critical view, discussing the restrictions that DP integration imposes, as well as bring to light the challenges that such restrictions entail. To accomplish this, we focus on $\textbf{DP-Prompt}$, a recent method for text privatization leveraging language models to rewrite texts. In particular, we explore this rewriting task in multiple scenarios, both with DP and without DP. To drive the discussion on the merits of DP in NLP, we conduct empirical utility and privacy experiments. Our results demonstrate the need for more discussion on the usability of DP in NLP and its benefits over non-DP approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑