arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.14211cs.CL
收藏

ChronosLex:面向法律分类任务时间泛化的时间感知增量训练

ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks

Technical University of Munich(慕尼黑工业大学)

T. Y. S. S Santosh, Tuan-Quang Vuong, Matthias Grabmair

AI总结:

针对法律分类任务中概念随时间演变导致的模型性能下降,提出ChronosLex增量训练范式,按时间顺序训练,实验证明持续学习优于时间不变方法,能有效防止过拟合并提升时间泛化能力。

摘要:

本研究探讨了法律多标签文本分类任务因法律概念随时间演变而具有动态性所带来的挑战。现有模型在训练过程中往往忽略时间维度,将训练数据视为单一同质块,导致模型性能随时间推移而次优。为解决此问题,我们提出ChronosLex,一种增量训练范式,该范式按时间顺序划分数据并训练模型,保留数据的时间顺序。然而,这种增量方法引发了对过拟合近期数据的担忧,促使我们评估使用持续学习和时间不变方法的缓解策略。我们在六个法律多标签文本分类数据集上的实验结果表明,持续学习方法在防止过拟合从而增强时间泛化能力方面是有效的,而时间不变方法则难以捕捉时间转移的这些动态变化。

英文摘要:

This study investigates the challenges posed by the dynamic nature of legal multi-label text classification tasks, where legal concepts evolve over time. Existing models often overlook the temporal dimension in their training process, leading to suboptimal performance of those models over time, as they treat training data as a single homogeneous block. To address this, we introduce ChronosLex, an incremental training paradigm that trains models on chronological splits, preserving the temporal order of the data. However, this incremental approach raises concerns about overfitting to recent data, prompting an assessment of mitigation strategies using continual learning and temporal invariant methods. Our experimental results over six legal multi-label text classification datasets reveal that continual learning methods prove effective in preventing overfitting thereby enhancing temporal generalizability, while temporal invariant methods struggle to capture these dynamics of temporal shifts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑