arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.01799cs.CLcs.AIcs.LG
收藏

ContractNLI:一个用于合同文档级自然语言推理的数据集

ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts

Stanford University(斯坦福大学);Hitachi America Ltd(日立美国有限公司)

Yuta Koreeda, Christopher D. Manning

摘要:

审查合同是一个耗时的过程,招致大量的费用,公司和社会不平等的那些谁买不起it.In这项工作中,我们提出了“文件级自然语言推理(NLI)的合同”,一个新的,现实世界中的应用NLI,解决这些问题。在这项任务中,系统被赋予一组假设(如“协议的某些义务可能在终止后继续存在。“)和合同,并要求对每一项假设进行分类,确定每一项假设是否为合同“所必然”、“与合同相矛盾”或“未被合同提及”(对合同中性),并将决定的“证据”确定为合同中的跨度。我们注释并发布了迄今为止最大的语料库,包括607个注释合同。然后,我们发现现有的模型在我们的任务中失败得很严重,并引入了一个强大的基线,(1)将证据识别建模为跨度上的多标签分类,而不是试图预测开始和结束标记,(2)采用更复杂的上下文分割来处理长文档。我们还表明,合同的语言特点,如否定的例外情况,有助于这项任务的难度,有很大的改进空间。

英文摘要:

Reviewing contracts is a time-consuming procedure that incurs large expenses to companies and social inequality to those who cannot afford it. In this work, we propose "document-level natural language inference (NLI) for contracts", a novel, real-world application of NLI that addresses such problems. In this task, a system is given a set of hypotheses (such as "Some obligations of Agreement may survive termination.") and a contract, and it is asked to classify whether each hypothesis is "entailed by", "contradicting to" or "not mentioned by" (neutral to) the contract as well as identifying "evidence" for the decision as spans in the contract. We annotated and release the largest corpus to date consisting of 607 annotated contracts. We then show that existing models fail badly on our task and introduce a strong baseline, which (1) models evidence identification as multi-label classification over spans instead of trying to predict start and end tokens, and (2) employs more sophisticated context segmentation for dealing with long documents. We also show that linguistic characteristics of contracts, such as negations by exceptions, are contributing to the difficulty of this task and that there is much room for improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑