arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1803.00985cs.CL
收藏

基于朴素贝叶斯和潜在信息的词预测混合模型

Hybrid Model For Word Prediction Using Naive Bayes and Latent Information

Henrique X. Goulart, Mauro D. L. Tosi, Daniel Soares Gonçalves, Rodrigo F. Maia, Guilherme A. Wachs-Lopes

摘要:

从历史上看,自然语言处理领域受到了许多研究人员的关注。除了这个兴趣之外的主要动机之一与单词预测问题有关,该问题指出,给定句子中的一组单词,可以推荐下一个单词。在文献中,这个问题是解决的方法基于句法或语义分析。单独地,这些分析中的每一个都不能为最终用户应用实现实际结果。例如,潜在语义分析可以处理文本的语义特征,但不能建议考虑语法规则的单词。另一方面,也有一些模型将这两种方法结合在一起,并获得了最先进的结果,例如深度学习。这些模型可能需要高计算量,这可能使模型对于某些类型的应用程序不可行。随着技术和数学模型的进步,有可能开发出更快、更准确的系统。这项工作提出了一个混合词建议模型,基于朴素贝叶斯和潜在语义分析,考虑周围未填充的空白相邻的话。结果表明,该模型在MSR句子完成挑战中可以达到44.2%的准确率。

英文摘要:

Historically, the Natural Language Processing area has been given too much attention by many researchers. One of the main motivation beyond this interest is related to the word prediction problem, which states that given a set words in a sentence, one can recommend the next word. In literature, this problem is solved by methods based on syntactic or semantic analysis. Solely, each of these analysis cannot achieve practical results for end-user applications. For instance, the Latent Semantic Analysis can handle semantic features of text, but cannot suggest words considering syntactical rules. On the other hand, there are models that treat both methods together and achieve state-of-the-art results, e.g. Deep Learning. These models can demand high computational effort, which can make the model infeasible for certain types of applications. With the advance of the technology and mathematical models, it is possible to develop faster systems with more accuracy. This work proposes a hybrid word suggestion model, based on Naive Bayes and Latent Semantic Analysis, considering neighbouring words around unfilled gaps. Results show that this model could achieve 44.2% of accuracy in the MSR Sentence Completion Challenge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑