arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.03394cs.CLcs.LG
收藏

面向课程评价的意见挖掘与主题分类的深度学习研究

Deep Learning for Opinion Mining and Topic Classification of Course Reviews

Florida Gulf Coast University(佛罗里达海湾海岸大学)

Anna Koufakou

AI总结:

本文利用BERT、RoBERTa、XLNet等深度学习方法与传统模型对课程评价进行情感极性和主题分类对比,其中RoBERTa在情感分类上准确率达95.5%,SVM在主题分类上表现最佳,为教育机构分析课程反馈提供了实践指南。

摘要:

无论课程类型或院校如何,学生对课程的意见对教育工作者和管理者都十分重要。在院校层面或在线论坛中,对海量开放式反馈进行人工阅读和分析变得不可行。本文收集并预处理了大量公开在线的课程评价。我们应用机器学习技术,旨在洞察学生情感和主题。具体而言,我们利用了当前的自然语言处理(NLP)技术,如词嵌入和深度神经网络,以及最先进的BERT(来自Transformer的双向编码器表示)、RoBERTa(稳健优化的BERT方法)和XLNet(广义自回归预训练)。我们进行了大量实验,以比较这些技术与传统方法。这项对比研究展示了如何利用课程反馈应用现代机器学习方法进行情感极性提取和基于主题的分类。在情感极性方面,最佳模型是RoBERTa,准确率为95.5%,F1-macro为84.7%;而在主题分类方面,SVM(支持向量机)是最佳分类器,准确率为79.8%,F1-macro为80.6%。我们还深入探讨了某些超参数对模型性能的影响,并讨论了我们的观察结果。这些发现可供院校和课程提供者作为指南,用于通过NLP模型分析自己的课程反馈,以实现自我评估和改进。

英文摘要:

Student opinions for a course are important to educators and administrators, regardless of the type of the course or the institution. Reading and manually analyzing open-ended feedback becomes infeasible for massive volumes of comments at institution level or online forums. In this paper, we collected and pre-processed a large number of course reviews publicly available online. We applied machine learning techniques with the goal to gain insight into student sentiments and topics. Specifically, we utilized current Natural Language Processing (NLP) techniques, such as word embeddings and deep neural networks, and state-of-the-art BERT (Bidirectional Encoder Representations from Transformers), RoBERTa (Robustly optimized BERT approach) and XLNet (Generalized Auto-regression Pre-training). We performed extensive experimentation to compare these techniques versus traditional approaches. This comparative study demonstrates how to apply modern machine learning approaches for sentiment polarity extraction and topic-based classification utilizing course feedback. For sentiment polarity, the top model was RoBERTa with 95.5% accuracy and 84.7% F1-macro, while for topic classification, an SVM (Support Vector Machine) was the top classifier with 79.8% accuracy and 80.6% F1-macro. We also provided an in-depth exploration of the effect of certain hyperparameters on the model performance and discussed our observations. These findings can be used by institutions and course providers as a guide for analyzing their own course feedback using NLP models towards self-evaluation and improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑