arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.08673cs.CLcs.AIcs.CYcs.LG
收藏

应用于科学文本的、用于区分大语言模型生成来源与人类来源的情感分析与随机森林分类方法

Sentiment analysis and random forest to classify LLM versus human source applied to Scientific Texts

CICEI - IUCES, ULPGC(CICEI - IUCES,大加那利岛拉斯帕尔马斯大学)

Javier J. Sanchez-Medina

AI总结:

针对AI生成文本泛滥带来的学术造假等问题,本研究提出以情感分析提取特征、训练随机森林模型来区分科学文本的人类或大语言模型来源,实验验证了该方法的应用潜力。

摘要:

ChatGPT 4.0推出后,全球范围内围绕这款人工智能驱动平台及其他同类平台自动生成各类文本(包括科技文本)的能力展开了热烈讨论。这也引发了众多机构的思考:未来我们读到的许多文本将并非由人类(学生、学者等)撰写,至少并非完全由人类撰写,教育和学术流程是否应当适配这一现实。本研究提出了一种区分文本来自自动文本生成引擎还是人类的新方法,该方法以情感分析作为特征工程自变量的来源,再用这些自变量训练随机森林(Random Forest)分类算法。研究使用4种不同的情感词典生成了若干新特征,再将其输入机器学习随机森林方法以训练模型。结果十分具有说服力,表明在文本本应由人类创作的场景中,该方法有望成为检测造假的有效研究方向。

英文摘要:

After the launch of ChatGPT v.4 there has been a global vivid discussion on the ability of this artificial intelligence powered platform and some other similar ones for the automatic production of all kinds of texts, including scientific and technical texts. This has triggered a reflection in many institutions on whether education and academic procedures should be adapted to the fact that in future many texts we read will not be written by humans (students, scholars, etc.), at least, not entirely. In this work it is proposed a new methodology to classify texts coming from an automatic text production engine or a human, based on Sentiment Analysis as a source for feature engineering independent variables and then train with them a Random Forest classification algorithm. Using four different sentiment lexicons, a number of new features where produced, and then fed to a machine learning random forest methodology, to train such a model. Results seem very convincing that this may be a promising research line to detect fraud, in such environments where human are supposed to be the source of texts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑