PLUE:英文隐私政策语言理解评估基准
PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English
AI总结:
本文提出PLUE基准,一个多任务评估隐私政策语言理解的基准,并收集大规模语料进行领域特定预训练,证明持续预训练提升所有任务性能。
摘要:
隐私政策为个人提供关于其权利以及个人信息如何处理的信息。自然语言理解(NLU)技术可以支持个人和从业者更好地理解冗长复杂文档中描述的隐私实践。然而,现有的利用NLU技术的努力受到限制,因为它们以特定于单一任务的方式处理语言,仅关注某些隐私实践。为此,我们引入了隐私政策语言理解评估(PLUE)基准,这是一个多任务基准,用于评估跨各种任务的隐私政策语言理解能力。我们还收集了一个大规模的隐私政策语料库,以实现隐私政策领域的语言模型预训练。我们评估了几种通用的预训练语言模型,并在收集的语料库上继续预训练它们。我们证明,领域特定的持续预训练在所有任务上提供了性能改进。
英文摘要:
Privacy policies provide individuals with information about their rights and how their personal information is handled. Natural language understanding (NLU) technologies can support individuals and practitioners to understand better privacy practices described in lengthy and complex documents. However, existing efforts that use NLU technologies are limited by processing the language in a way exclusive to a single task focusing on certain privacy practices. To this end, we introduce the Privacy Policy Language Understanding Evaluation (PLUE) benchmark, a multi-task benchmark for evaluating the privacy policy language understanding across various tasks. We also collect a large corpus of privacy policies to enable privacy policy domain-specific language model pre-training. We evaluate several generic pre-trained language models and continue pre-training them on the collected corpus. We demonstrate that domain-specific continual pre-training offers performance improvements across all tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。