arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.01715cs.CL
收藏

基于朴素贝叶斯分类器和潜在语义分析的Web文档分类

Web Document Categorization Using Naive Bayes Classifier and Latent Semantic Analysis

Iran University of Science and Technology(伊朗科学技术大学);Umeå University(于默奥大学)

Alireza Saleh Sedghpour, Mohammad Reza Saleh Sedghpour

摘要:

由于大量使用万维网的Web文档的快速增长,需要有效的技术来有效地分类在Web上的文档。因此,它产生了每秒高容量的数据,具有高多样性。自动分类这些不断增长的Web文档量是我们今天面临的最大挑战之一。概率分类算法,如朴素贝叶斯已成为常用的Web文档分类。这主要是因为在很多应用领域中分类精度不高,以及对文本数据表示所独有的高维稀疏数据缺乏支持。传统的特征选择方法在处理大数据、大规模Web文档时,往往缺乏对词与词之间语义关系的关注和支持。为了解决这个问题,我们提出了一种Web文档分类方法,使用LSA来增加同类文档的相似性,提高分类精度。使用这种方法,我们设计了一个更快,更准确的分类器的Web文档。实验结果表明,采用上述预处理方法可以有效地提高朴素贝叶斯分类器的准确率和速度,准确率和召回率指标都得到了提高。

英文摘要:

A rapid growth of web documents due to heavy use of World Wide Web necessitates efficient techniques to efficiently classify the document on the web. It is thus produced High volumes of data per second with high diversity. Automatically classification of these growing amounts of web document is One of the biggest challenges facing us today. Probabilistic classification algorithms such as Naive Bayes have become commonly used for web document classification. This problem is mainly because of the irrelatively high classification accuracy on plenty application areas as well as their lack of support to handle high dimensional and sparse data which is the exclusive characteristics of textual data representation. also it is common to Lack of attention and support the semantic relation between words using traditional feature selection method When dealing with the big data and large-scale web documents. In order to solve the problem, we proposed a method for web document classification that uses LSA to increase similarity of documents under the same class and improve the classification precision. Using this approach, we designed a faster and much accurate classifier for Web Documents. Experimental results have shown that using the mentioned preprocessing can improve accuracy and speed of Naive Bayes availably, the precision and recall metrics have indicated the improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑