arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.01722cs.IR
收藏

机器学习和关键词方法在法律事务文档审查项目中应用的实证研究

An Empirical Study of the Application of Machine Learning and Keyword Terms Methodologies to Privilege-Document Review Projects in Legal Matters

Peter Gronvall, Nathaniel Huber-Fliflet, Jianping Zhang, Robert Keeling, Robert Neary, Haozhen Zhao

摘要:

保护特权通信和数据不被披露对法律团队至关重要。不受限制的法律建议,如律师与客户的沟通或诉讼策略。对法律程序至关重要,在诉讼或监管事件中免于披露。为了保护这些信息不被披露,公司和外部法律顾问必须审查大量文件,以确定哪些文件包含特权材料。这个过程是非常昂贵和耗时的。随着数据量的增加,法律顾问采用各种方法来减少需要审查的文件数量,同时平衡确保保护特权信息的需要。关键词搜索是一种针对特权信息和减少文档审查人群的方法。关键字搜索在广撒网方面是有效的,但返回的结果是包容性的--其中大多数不包含特权信息--如果没有对数据的详细了解,关键字列表就无法找到所有特权材料。过于宽泛的关键词搜索也可能带来问题,因为即使它提高了成本,它也可能撒得“太远”,从而产生不可靠的结果。为了克服关键词搜索的这些弱点,法律团队正在使用一种新的方法来定位特权信息,称为预测建模。预测建模可以成功地识别特权材料,但很少有研究已经出版,以确认其有效性相比,关键字搜索。本文总结了关键字搜索和预测建模应用于现实世界的数据时的有效性的研究。通过这项研究,这组合作者希望检查和了解这两种方法对法律团队在文件人群中识别特权材料的好处和弱点。

英文摘要:

Protecting privileged communications and data from disclosure is paramount for legal teams. Unrestricted legal advice, such as attorney-client communications or litigation strategy. are vital to the legal process and are exempt from disclosure in litigations or regulatory events. To protect this information from being disclosed, companies and outside counsel must review vast amounts of documents to determine those that contain privileged material. This process is extremely costly and time consuming. As data volumes increase, legal counsel employ methods to reduce the number of documents requiring review while balancing the need to ensure the protection of privileged information. Keyword searching is relied upon as a method to target privileged information and reduce document review populations. Keyword searches are effective at casting a wide net but return over inclusive results -- most of which do not contain privileged information -- and without detailed knowledge of the data, keyword lists cannot be crafted to find all privilege material. Overly-inclusive keyword searching can also be problematic, because even while it drives up costs, it also can cast `too far of a net' and thus produce unreliable results.To overcome these weaknesses of keyword searching, legal teams are using a new method to target privileged information called predictive modeling. Predictive modeling can successfully identify privileged material but little research has been published to confirm its effectiveness when compared to keyword searching. This paper summarizes a study of the effectiveness of keyword searching and predictive modeling when applied to real-world data. With this study, this group of collaborators wanted to examine and understand the benefits and weaknesses of both approaches to legal teams with identifying privilege material in document populations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑