arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1801.04554cs.IRcs.CLcs.LG
收藏

DCDistance:一种基于类别标签的有监督文本特征提取

DCDistance: A Supervised Text Document Feature extraction based on class labels

Charles Henrique Porto Ferreira, Debora Maria Rossi de Medeiros, Fabricio Olivetti de França

摘要:

文本挖掘是一个旨在从文本数据中提取信息的领域。这样的研究领域的挑战之一来自预处理阶段,其中应该从非结构化数据中提取矢量(和结构化)表示。公共提取创建表示每个术语对文档的重要性的大而稀疏的向量。因此,这通常会导致困扰大多数机器学习算法的维数灾难。为了解决这个问题,在本文中,我们提出了一个新的监督特征提取和减少算法,命名为DCDistance,创建功能的基础上的距离之间的文件,以代表每个类标签。因此,所提出的技术可以减少超过99%的原始集的特征集。此外,该算法还能够提高分类精度在一组基准数据集相比,传统的和国家的最先进的特征选择算法。

英文摘要:

Text Mining is a field that aims at extracting information from textual data. One of the challenges of such field of study comes from the pre-processing stage in which a vector (and structured) representation should be extracted from unstructured data. The common extraction creates large and sparse vectors representing the importance of each term to a document. As such, this usually leads to the curse-of-dimensionality that plagues most machine learning algorithms. To cope with this issue, in this paper we propose a new supervised feature extraction and reduction algorithm, named DCDistance, that creates features based on the distance between a document to a representative of each class label. As such, the proposed technique can reduce the features set in more than 99% of the original set. Additionally, this algorithm was also capable of improving the classification accuracy over a set of benchmark datasets when compared to traditional and state-of-the-art features selection algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑