arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.07217cs.LGcs.AIcs.CL
收藏

用于个人属性推断的合成数据集

A Synthetic Dataset for Personal Attribute Inference

ETH Zurich(苏黎世联邦理工学院)

Hanna Yukhymenko, Robin Staab, Mark Vero, Martin Vechev

AI总结:

针对LLM从在线文本推断个人信息的隐私威胁,构建基于合成档案的Reddit模拟框架,生成含7800余条人工标注评论的SynthPAI数据集,并经人类研究与18个LLM验证其有效性。

摘要:

近年来,强大的大型语言模型(LLMs)已变得易于全球数亿用户访问。然而,其强大的能力和广博的世界知识并非没有相关的隐私风险。在这项工作中,我们关注LLMs带来的新兴隐私威胁——即从在线文本中准确推断个人信息的能力。尽管基于LLM的作者画像研究日益重要,但该领域的研究因缺乏合适的公开数据集而受阻,这主要是由于与真实个人数据相关的伦理和隐私问题。我们采取两个步骤来解决这一问题:(i)我们使用带有合成个人档案的LLM智能体,为流行的社交媒体平台Reddit构建了一个模拟框架;(ii)利用该框架,我们生成了SynthPAI,一个包含超过7800条人工标注个人属性评论的多样化合成数据集。我们通过一项人类研究验证了我们的数据集,该研究表明,在区分我们的合成评论与真实评论的任务中,人类的表现仅略优于随机猜测。此外,我们通过展示在18个最先进的LLM上,我们的合成评论使我们能够得出与真实世界数据相同的结论,验证了我们的数据集能够支持有意义的个人属性推断研究。综合来看,我们的实验结果、数据集和流程为未来旨在理解和缓解LLMs带来的基于推断的隐私威胁的隐私保护研究奠定了坚实基础。

英文摘要:

Recently, powerful Large Language Models (LLMs) have become easily accessible to hundreds of millions of users world-wide. However, their strong capabilities and vast world knowledge do not come without associated privacy risks. In this work, we focus on the emerging privacy threat LLMs pose -- the ability to accurately infer personal information from online texts. Despite the growing importance of LLM-based author profiling, research in this area has been hampered by a lack of suitable public datasets, largely due to ethical and privacy concerns associated with real personal data. We take two steps to address this problem: (i) we construct a simulation framework for the popular social media platform Reddit using LLM agents seeded with synthetic personal profiles; (ii) using this framework, we generate SynthPAI, a diverse synthetic dataset of over 7800 comments manually labeled for personal attributes. We validate our dataset with a human study showing that humans barely outperform random guessing on the task of distinguishing our synthetic comments from real ones. Further, we verify that our dataset enables meaningful personal attribute inference research by showing across 18 state-of-the-art LLMs that our synthetic comments allow us to draw the same conclusions as real-world data. Combined, our experimental results, dataset and pipeline form a strong basis for future privacy-preserving research geared towards understanding and mitigating inference-based privacy threats that LLMs pose.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑