arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.15426cs.CL
收藏

AI知道明年韩国CSAT中会出现哪些单词

AI Knows Which Words Will Appear in Next Year's Korean CSAT

AIEng.

Byunghyun Ban, Jejong Lee, Hyeonmok Hwang

AI总结:

本文提出基于文本挖掘的词类分类和LSTM词汇模式预测方法,通过AI-Score预测韩国CSAT词汇出现概率,在100分区域达100%准确率。

摘要:

本文介绍了一种基于文本挖掘的词类分类方法和基于LSTM的词汇模式预测方法。首先描述了一种基于简单文本出现频率分析的预处理方法。该方法作为数据筛选工具开发,但表现比先前工作高4.35~6.21倍。还提出了用于词汇出现模式预测的LSTM深度学习方法。AI对先前考试的各种数据窗口大小进行回归,以预测下一次考试中单词出现的概率。AI在各种数据窗口上的预测值作为加权和被处理成单一分数,我们称之为“AI-Score”,表示明年考试中单词出现的概率。所提出的方法在100分区域显示100%准确率,在分数超过60分的部分仅显示1.7%的预测误差。所有源代码在作者的GitHub存储库免费提供。(https://github.com/needleworm/bigdata_voca)

英文摘要:

A text-mining-based word class categorization method and LSTM-based vocabulary pattern prediction method are introduced in this paper. A preprocessing method based on simple text appearance frequency analysis is first described. This method was developed as a data screening tool but showed 4.35 ~ 6.21 times higher than previous works. An LSTM deep learning method is also suggested for vocabulary appearance pattern prediction method. AI performs a regression with various size of data window of previous exams to predict the probabilities of word appearance in the next exam. Predicted values of AI over various data windows are processed into a single score as a weighted sum, which we call an "AI-Score", which represents the probability of word appearance in next year's exam. Suggested method showed 100% accuracy at the range 100-score area and showed only 1.7% error of prediction in the section where the scores were over 60 points. All source codes are freely available at the authors' Git Hub repository. (https://github.com/needleworm/bigdata_voca)

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑