arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.00596cs.CLcs.IR
收藏

ECtHR-PCR:欧洲人权法院先例理解与先前案例检索数据集

ECtHR-PCR: A Dataset for Precedent Understanding and Prior Case Retrieval in the European Court of Human Rights

School of Computation, Information, and Technology(计算、信息与技术学院);Technical University of Munich(慕尼黑工业大学)

T. Y. S. S Santosh, Rashid Gustav Haddad, Matthias Grabmair

AI总结:

本文提出基于欧洲人权法院判决的PCR数据集ECtHR-PCR,分离事实与论证以支持先例检索的全面理解,并基准测试多种检索方法,揭示难度负采样无效及模型时间退化问题。

摘要:

在普通法司法管辖区,法律从业者依据遵循先例(stare decisis)原则,依靠先例来构建论证。随着案件数量逐年增长,先前案例检索(PCR)受到了广泛关注。除了缺乏真实世界规模之外,现有的PCR数据集并未模拟现实场景,因为它们的查询使用完整的案件文档,而仅对先前案例的引用进行了掩码处理。因此,查询会接触到在为尚未判决的案件构建论证时尚不可用的法律推理,以及引用掩码留下的虚假模式,这可能绕过对案件事实和法律原则的全面理解。为了解决这些局限性,我们基于欧洲人权法院(ECtHR)的判决引入了一个PCR数据集,该数据集明确将事实与论证分开,并展现出先例实践,有助于我们开发这个PCR数据集以促进系统的全面理解。我们使用各种负采样策略对不同的词法和稠密检索方法进行了基准测试,并通过层次化变体使其适应长文本序列的处理。我们发现基于难度的负采样策略对PCR任务并不有效,这凸显了研究领域特定难度标准的必要性。此外,我们观察到稠密模型的性能随时间推移而下降,这要求对检索模型的时间适应性进行进一步研究。另外,我们利用PCR任务评估了不同观点——Halsbury观点和Goodhart观点——在欧洲人权法院司法实践中的影响。

英文摘要:

In common law jurisdictions, legal practitioners rely on precedents to construct arguments, in line with the doctrine of \emph{stare decisis}. As the number of cases grow over the years, prior case retrieval (PCR) has garnered significant attention. Besides lacking real-world scale, existing PCR datasets do not simulate a realistic setting, because their queries use complete case documents while only masking references to prior cases. The query is thereby exposed to legal reasoning not yet available when constructing an argument for an undecided case as well as spurious patterns left behind by citation masks, potentially short-circuiting a comprehensive understanding of case facts and legal principles. To address these limitations, we introduce a PCR dataset based on judgements from the European Court of Human Rights (ECtHR), which explicitly separate facts from arguments and exhibit precedential practices, aiding us to develop this PCR dataset to foster systems' comprehensive understanding. We benchmark different lexical and dense retrieval approaches with various negative sampling strategies, adapting them to deal with long text sequences using hierarchical variants. We found that difficulty-based negative sampling strategies were not effective for the PCR task, highlighting the need for investigation into domain-specific difficulty criteria. Furthermore, we observe performance of the dense models degrade with time and calls for further research into temporal adaptation of retrieval models. Additionally, we assess the influence of different views , Halsbury's and Goodhart's, in practice in ECtHR jurisdiction using PCR task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑