arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.07019cs.CLcs.AIcs.CY
收藏

复合词中的关键短语分类

Key Phrase Classification in Complex Assignments

Manikandan Ravikiran

摘要:

复杂的作业通常包括开放式问题,在课堂和在线研究生课程的背景下,内容广泛而多样。随着这些项目的庞大规模,同行和专家反馈中出现了各种问题,包括流氓评论。因此,希望确定审查所需的重要内容,在这项工作中,我们提出了一个非常重要的关键短语分类与传统的和最新的语言建模方法进行了详细的实证研究的第一项工作。从这项研究中,我们发现,关键短语的分类任务是模糊的,在人类水平上生产科恩的Kappa值为0.77的一个新的数据集。预训练的语言模型和简单的TFIDF SVM分类器都产生类似的结果,前者产生的平均值比后者高0.6 F1。最后,我们从我们广泛的经验和模型的可解释性结果,为那些有兴趣在未来的教育报告中的关键短语分类实用的建议。

英文摘要:

Complex assignments typically consist of open-ended questions with large and diverse content in the context of both classroom and online graduate programs. With the sheer scale of these programs comes a variety of problems in peer and expert feedback, including rogue reviews. As such with the hope of identifying important contents needed for the review, in this work we present a very first work on key phrase classification with a detailed empirical study on traditional and most recent language modeling approaches. From this study, we find that the task of classification of key phrases is ambiguous at a human level producing Cohen's kappa of 0.77 on a new data set. Both pretrained language models and simple TFIDF SVM classifiers produce similar results with a former producing average of 0.6 F1 higher than the latter. We finally derive practical advice from our extensive empirical and model interpretability results for those interested in key phrase classification from educational reports in the future.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑