消除风险而非压制吹哨:一种用于降低吹哨人再识别风险的半自动文本净化工具
Silencing the Risk, Not the Whistle: A Semi-automated Text Sanitization Tool for Mitigating the Risk of Whistleblower Re-Identification
AI总结:
本文提出一种半自动文本净化工具,通过风险自适应匿名化与微调LLM改写,在保留语义的同时将吹哨人作者归属攻击准确率从98.81%降至31.22%。
摘要:
吹哨行为对于确保公共和私营部门的透明度与问责制至关重要。然而,(潜在的)吹哨人即使在匿名举报时,也常常担心或面临报复。其披露内容的具体细节和独特的写作风格可能使其作为信息来源被再识别。诸如欧盟吹哨指令(EU WBD)等法律措施在范围和有效性上存在局限。因此,用于防止再识别的计算方法成为鼓励吹哨人挺身而出的重要补充工具。然而,当前的文本净化工具采用一刀切的方法,并且对匿名性的理解过于狭隘。它们旨在通过将典型的高风险词(如人名和其他命名实体标签)及其组合替换为占位符来降低识别风险。然而,这种方法对于吹哨场景而言并不充分,因为它忽视了文本特征中进一步的再识别可能性,包括写作风格。因此,我们提出、实现并评估了一种新颖的分类与缓解策略,用于重写文本,并让吹哨人参与风险和效用的评估。我们的原型工具在半自动层面评估词/术语级别的风险,并应用风险自适应的匿名化技术,生成语法上不连贯但经过适当净化的文本。随后,我们使用一个经过微调用于改写的LLM,使该文本变得连贯且风格中立。我们使用欧洲人权法院(ECHR)的法庭案例和真实吹哨人证词摘录来评估我们工具的有效性,并使用流行的IMDb62电影评论数据集从统计上衡量对作者归属(AA)攻击的防护能力和效用损失。我们的方法能够将AA准确率从98.81%显著降低至31.22%,同时保留原始内容高达73.1%的语义。
英文摘要:
Whistleblowing is essential for ensuring transparency and accountability in both public and private sectors. However, (potential) whistleblowers often fear or face retaliation, even when reporting anonymously. The specific content of their disclosures and their distinct writing style may re-identify them as the source. Legal measures, such as the EU WBD, are limited in their scope and effectiveness. Therefore, computational methods to prevent re-identification are important complementary tools for encouraging whistleblowers to come forward. However, current text sanitization tools follow a one-size-fits-all approach and take an overly limited view of anonymity. They aim to mitigate identification risk by replacing typical high-risk words (such as person names and other NE labels) and combinations thereof with placeholders. Such an approach, however, is inadequate for the whistleblowing scenario since it neglects further re-identification potential in textual features, including writing style. Therefore, we propose, implement, and evaluate a novel classification and mitigation strategy for rewriting texts that involves the whistleblower in the assessment of the risk and utility. Our prototypical tool semi-automatically evaluates risk at the word/term level and applies risk-adapted anonymization techniques to produce a grammatically disjointed yet appropriately sanitized text. We then use a LLM that we fine-tuned for paraphrasing to render this text coherent and style-neutral. We evaluate our tool's effectiveness using court cases from the ECHR and excerpts from a real-world whistleblower testimony and measure the protection against authorship attribution (AA) attacks and utility loss statistically using the popular IMDb62 movie reviews dataset. Our method can significantly reduce AA accuracy from 98.81% to 31.22%, while preserving up to 73.1% of the original content's semantics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。