arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.00080cs.CLcs.LG
收藏

基于能力评估的课程学习数据动态选择

Dynamic Data Selection for Curriculum Learning via Ability Estimation

Department of IT, Analytics, and Operations, University of Notre Dame(圣母大学IT、分析与运营系);Department of Computer Science, University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校计算机科学系);College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校信息与计算机科学学院)

John P. Lalor, Hong Yu

摘要:

课程学习方法通常依赖于数学来估计训练样本的难度或模型的能力。在这项工作中,我们建议用学习的难度参数来代替难度计算。我们还提出了动态数据选择课程学习通过能力估计(DDaCLAE),一个策略,探测模型的能力,在每个训练时期选择最好的训练样本在这一点上。我们发现,模型学习困难和/或能力优于基于经验的课程学习模型的GLUE分类任务。

英文摘要:

Curriculum learning methods typically rely on heuristics to estimate the difficulty of training examples or the ability of the model. In this work, we propose replacing difficulty heuristics with learned difficulty parameters. We also propose Dynamic Data selection for Curriculum Learning via Ability Estimation (DDaCLAE), a strategy that probes model ability at each training epoch to select the best training examples at that point. We show that models using learned difficulty and/or ability outperform heuristic-based curriculum learning models on the GLUE classification tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑