arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.17790cs.CL
收藏

Mashee at SemEval-2024 Task 8: 样本质量对机器文本分类中上下文学习性能的影响

Mashee at SemEval-2024 Task 8: The Impact of Samples Quality on the Performance of In-Context Learning for Machine Text Classification

College of Information Engineering(信息工程学院);Al-Nahrain University(纳赫兰大学);Software Engineering(软件工程)

Areeg Fahad Rasheed, M. Zarkoosh

AI总结:

本文研究少样本学习中样本质量对上下文学习(ICL)性能的影响,提出使用卡方检验筛选高质量样本,实验证明高质量样本能全面提升机器文本分类的各项评估指标表现。

摘要:

在少样本学习中,上下文学习(ICL)已成为一种潜在方法,通过利用上下文信息来提升模型在小数据量或资源受限环境下的性能,在这些环境中,基于大型数据集训练模型是不可行的。然而,少样本中所选样本的质量严重限制了ICL的有效性。本文的主要目标是通过在少样本学习场景中选择高质量样本来提升上下文学习评估指标的性能。我们采用卡方检验来识别高质量样本,并将结果与使用低质量样本所得的结果进行比较。研究结果表明,利用高质量样本在所有评估指标上均带来了性能提升。

英文摘要:

Within few-shot learning, in-context learning (ICL) has become a potential method for leveraging contextual information to improve model performance on small amounts of data or in resource-constrained environments where training models on large datasets is prohibitive. However, the quality of the selected sample in a few shots severely limits the usefulness of ICL. The primary goal of this paper is to enhance the performance of evaluation metrics for in-context learning by selecting high-quality samples in few-shot learning scenarios. We employ the chi-square test to identify high-quality samples and compare the results with those obtained using low-quality samples. Our findings demonstrate that utilizing high-quality samples leads to improved performance with respect to all evaluated metrics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑