利用信息论消除法律文件的重复
Simplify Your Law: Using Information Theory to Deduplicate Legal Documents
摘要:
文本冗余是确保法律文本易于理解和维护的主要挑战之一。从软件工程中的重构文献中得到启发,开发了暴露和消除重复代码的方法,我们引入了法律文本的重复短语检测问题,并提出了Dupex算法来解决它。利用信息论的最小描述长度原则,Dupex识别出一组重复短语,称为模式,它们一起最好地压缩给定的输入文本。通过对美国法典标题的大量实验,我们确认我们的算法在实践中运行良好:Dupex将帮助您简化法律。
英文摘要:
Textual redundancy is one of the main challenges to ensuring that legal texts remain comprehensible and maintainable. Drawing inspiration from the refactoring literature in software engineering, which has developed methods to expose and eliminate duplicated code, we introduce the duplicated phrase detection problem for legal texts and propose the Dupex algorithm to solve it. Leveraging the Minimum Description Length principle from information theory, Dupex identifies a set of duplicated phrases, called patterns, that together best compress a given input text. Through an extensive set of experiments on the Titles of the United States Code, we confirm that our algorithm works well in practice: Dupex will help you simplify your law.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。