arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.16490cs.CL
收藏

eagerlearners 参与 SemEval2024 任务5:民事诉讼中的法律论证推理任务

eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure

Iran University of Science and Technology(伊朗科学技术大学)

Hoorieh Sabzevari, Mohammadmostafa Rostamkhani, Sauleh Eetemadi

AI总结:

本研究针对美国民事诉讼法律论证推理任务,对比大语言模型零样本方法与大输入、法律预训练模型的表现,在相关法律数据集上取得64%的最高F1分数,验证了零样本方法处理法律复杂数据的能力。

摘要:

本研究探究了零样本方法在数据分类任务中的表现,实验用到三款大语言模型,同时搭配两款支持大输入token规模的模型,以及两款在法律数据上预训练的模型。我们的主数据集来自美国民事诉讼领域,包含法律案件摘要、具体问题、候选答案,以及每个解决方案为何相关的详细解释,所有数据均取自一本面向法学生的书籍。通过对比不同方法,我们旨在了解它们应对法律数据中复杂问题的有效程度。研究结果揭示了大语言模型的零样本方法对复杂数据的理解能力,我们在这些实验中取得了64%的最高F1分数。

英文摘要:

This study investigates the performance of the zero-shot method in classifying data using three large language models, alongside two models with large input token sizes and the two pre-trained models on legal data. Our main dataset comes from the domain of U.S. civil procedure. It includes summaries of legal cases, specific questions, potential answers, and detailed explanations for why each solution is relevant, all sourced from a book aimed at law students. By comparing different methods, we aimed to understand how effectively they handle the complexities found in legal datasets. Our findings show how well the zero-shot method of large language models can understand complicated data. We achieved our highest F1 score of 64% in these experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑