隐私政策随时间的变化：百万文档数据集的管理和分析
Privacy Policies over Time: Curation and Analysis of a Million-Document Dataset
摘要：
隐私策略的自动分析已经被证明是一个富有成效的研究方向，其发展包括自动策略总结、问答系统和合规性检测。此前的研究仅限于从单个时间点或短时间内分析隐私政策，因为研究人员无法访问大规模的纵向策划数据集。为了解决这个问题，我们开发了一个爬虫程序，它可以从Internet Archive的Wayback Machine中发现、下载和提取存档的隐私策略。使用爬虫程序并遵循一系列验证和质量控制步骤，我们策划了一个包含1，071，488条英语隐私政策的数据集，跨越了二十多年的时间和超过130，000个不同的网站。我们对数据的分析描绘了隐私政策透明度和可访问性的令人不安的画面。通过将我们数据集中与跟踪相关的术语的出现与之前的网络隐私测量进行比较，我们发现隐私政策始终未能披露常见跟踪技术和第三方的存在。我们还发现，在过去的20年里，隐私政策变得更加难以阅读，长度翻了一番，阅读水平中位数提高了一个完整的等级。我们的数据表明，第一方网站的自我监管停滞不前，而第三方网站的自我监管有所增加，但主要是在线广告行业协会。最后，我们通过展示GDPR对隐私政策的历史影响，为隐私监管文献做出贡献。
英文摘要：
Automated analysis of privacy policies has proved a fruitful research direction, with developments such as automated policy summarization, question answering systems, and compliance detection. Prior research has been limited to analysis of privacy policies from a single point in time or from short spans of time, as researchers did not have access to a large-scale, longitudinal, curated dataset. To address this gap, we developed a crawler that discovers, downloads, and extracts archived privacy policies from the Internet Archive's Wayback Machine. Using the crawler and following a series of validation and quality control steps, we curated a dataset of 1,071,488 English language privacy policies, spanning over two decades and over 130,000 distinct websites. Our analyses of the data paint a troubling picture of the transparency and accessibility of privacy policies. By comparing the occurrence of tracking-related terminology in our dataset to prior web privacy measurements, we find that privacy policies have consistently failed to disclose the presence of common tracking technologies and third parties. We also find that over the last twenty years privacy policies have become even more difficult to read, doubling in length and increasing a full grade in the median reading level. Our data indicate that self-regulation for first-party websites has stagnated, while self-regulation for third parties has increased but is dominated by online advertising trade associations. Finally, we contribute to the literature on privacy regulation by demonstrating the historic impact of the GDPR on privacy policies.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
