arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.06823cs.LGcs.AI
收藏

课程学习评分函数的发展与比较

Development and Comparison of Scoring Functions in Curriculum Learning

Yildiz Technical University(耶尔德兹技术大学)

H. Toprak Kesgin, M. Fatih Amasyali

摘要:

课程学习是将样本以有意义的顺序而不是随机顺序呈现给机器学习模型。课程学习的主要挑战是确定如何对这些样本进行排序。样本的排序由评分函数表示。在这项研究中,使用数据集特征,使用待训练的模型,以及使用另一个模型及其集成版本来比较评分函数。对4幅图像和4个文本数据集进行了实验。在文本数据集的评分函数之间没有发现显著差异,但是与经典模型训练和图像数据集的其他评分函数相比,使用迁移学习创建的评分函数获得了显著改进。这表明,不同的新的评分功能,等待被发现的文本分类任务。

英文摘要:

Curriculum Learning is the presentation of samples to the machine learning model in a meaningful order instead of a random order. The main challenge of Curriculum Learning is determining how to rank these samples. The ranking of the samples is expressed by the scoring function. In this study, scoring functions were compared using data set features, using the model to be trained, and using another model and their ensemble versions. Experiments were performed for 4 images and 4 text datasets. No significant differences were found between scoring functions for text datasets, but significant improvements were obtained in scoring functions created using transfer learning compared to classical model training and other scoring functions for image datasets. It shows that different new scoring functions are waiting to be found for text classification tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑