arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.06268cs.CLcs.LG
收藏

CUAD:一个用于法律合同审查的专家注释的NLP数据集

CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review

UC Berkeley(加州大学伯克利分校);The Nueva School(努埃瓦学校)

Dan Hendrycks, Collin Burns, Anya Chen, Spencer Ball

摘要:

许多专业领域仍然没有受到深度学习的影响,因为大型标记数据集需要昂贵的专家注释器。我们通过引入合同理解Atticus数据集(CUAD)来解决法律领域内的这一瓶颈,CUAD是一种用于法律合同审查的新数据集。CUAD由来自Atticus Project的数十位法律专家创建,由13,000多条注释组成。任务是突出合同中对人类审查很重要的突出部分。我们发现,Transformer模型具有新生的性能,但这种性能受到模型设计和训练数据集大小的强烈影响。尽管取得了这些可喜的成果,但仍有很大的改进余地。作为唯一一个由专家注释的大型专业NLP基准之一,CUAD可以作为更广泛的NLP社区的一个具有挑战性的研究基准。

英文摘要:

Many specialized domains remain untouched by deep learning, as large labeled datasets require expensive expert annotators. We address this bottleneck within the legal domain by introducing the Contract Understanding Atticus Dataset (CUAD), a new dataset for legal contract review. CUAD was created with dozens of legal experts from The Atticus Project and consists of over 13,000 annotations. The task is to highlight salient portions of a contract that are important for a human to review. We find that Transformer models have nascent performance, but that this performance is strongly influenced by model design and training dataset size. Despite these promising results, there is still substantial room for improvement. As one of the only large, specialized NLP benchmarks annotated by experts, CUAD can serve as a challenging research benchmark for the broader NLP community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑