arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.11528cs.CRcs.AIcs.CL
收藏

别跟踪我!对抗大语言模型中属性推断攻击的主动防御

Stop Tracking Me! Proactive Defense Against Attribute Inference Attack in LLMs

School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)

Dong Yan, Jian Liang, Ran He, Tieniu Tan

AI总结:

本文提出TRACE-RPS框架,通过细粒度匿名化和推断阻止优化,有效降低大语言模型中属性推断准确性,实现隐私保护与模型效用的平衡。

摘要:

近期研究表明,大语言模型(LLMs)可通过用户在线生成的文本推断隐私属性(如年龄、位置、性别),导致快速大规模隐私泄露。现有基于匿名化的防御方法粒度粗,无法在词级别精确匿名化隐私泄露元素。此外,它们本质上受限,因为修改用户文本以隐藏敏感线索仍允许模型通过推理能力进行属性推断。为解决这些限制,我们提出一个统一的防御框架,结合细粒度匿名化(TRACE)与推断阻止优化(RPS)。TRACE利用注意力机制和推断链生成来识别和匿名化隐私泄露的文本元素,而RPS采用轻量级两阶段优化策略以诱导模型拒绝行为,从而防止属性推断。在不同LLM上的评估表明,TRACE-RPS将开源模型中属性推断准确性从约50%降低到低于5%。此外,我们的方法提供强大的跨模型泛化能力、提示变化鲁棒性和效用-隐私权衡。我们的代码可在https://github.com/Jasper-Yan/TRACE-RPS获取。

英文摘要:

Recent studies have shown that large language models (LLMs) can infer private user attributes (e.g., age, location, gender) from user-generated text shared online, enabling rapid and large-scale privacy breaches. Existing anonymization-based defenses are coarse-grained, lacking word-level precision in anonymizing privacy-leaking elements. Moreover, they are inherently limited as altering user text to hide sensitive cues still allows attribute inference to occur through models' reasoning capabilities. To address these limitations, we propose a unified defense framework that combines fine-grained anonymization (TRACE) with inference-preventing optimization (RPS). TRACE leverages attention mechanisms and inference chain generation to identify and anonymize privacy-leaking textual elements, while RPS employs a lightweight two-stage optimization strategy to induce model rejection behaviors, thereby preventing attribute inference. Evaluations across diverse LLMs show that TRACE-RPS reduces attribute inference accuracy from around 50\% to below 5\% on open-source models. In addition, our approach offers strong cross-model generalization, prompt-variation robustness, and utility-privacy tradeoffs. Our code is available at https://github.com/Jasper-Yan/TRACE-RPS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑