arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.03283cs.IRcs.LG
收藏

主成分分析与不同文本分类器的比较研究

A Comparative Study on using Principle Component Analysis with Different Text Classifiers

Assiut University(艾斯尤特大学)

Ahmed I. Taloba, D. A. Eisa, Safaa S. I. Ismail

摘要:

文本分类(TC)是将一组文档自动组织成一组预定义类别的任务。在过去的几年里,越来越多的注意力已经支付给数字形式的文件的使用,这使得文本分类成为一个具有挑战性的问题。文本分类的最大问题是其大量的特征。这些特征中的大多数是冗余的、噪声的和不相关的,导致与大多数分类器的过度拟合。因此,特征提取是提高文本分类器整体精度和性能的重要步骤。在本文中,我们将提供一个概述使用主成分分析(PCA)作为特征提取与各种分类器。实验结果表明,采用PCA降维后,分类器的性能得到了提高。实验在Classic 03、CNAE-9和DBWorld三个UCI数据集上进行。我们比较了使用PCA与流行和知名的文本分类器的分类性能结果。结果表明,使用PCA大大提高了大多数分类器的分类性能。

英文摘要:

Text categorization (TC) is the task of automatically organizing a set of documents into a set of pre-defined categories. Over the last few years, increased attention has been paid to the use of documents in digital form and this makes text categorization becomes a challenging issue. The most significant problem of text categorization is its huge number of features. Most of these features are redundant, noisy and irrelevant that cause over fitting with most of the classifiers. Hence, feature extraction is an important step to improve the overall accuracy and the performance of the text classifiers. In this paper, we will provide an overview of using principle component analysis (PCA) as a feature extraction with various classifiers. It was observed that the performance rate of the classifiers after using PCA to reduce the dimension of data improved. Experiments are conducted on three UCI data sets, Classic03, CNAE-9 and DBWorld e-mails. We compare the classification performance results of using PCA with popular and well-known text classifiers. Results show that using PCA encouragingly enhances classification performance on most of the classifiers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑