arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1410.0640cs.NEcs.LG
收藏

基于遗传编程的词加权学习文本分类

Term-Weighting Learning via Genetic Programming for Text Classification

Instituto Nacional de Astrofísica, Óptica y Electrónica(国家天体物理、光学与电子研究所);Universidad Michoacana de San Nicolás de Hidalgo(米却肯州圣尼古拉斯·伊达尔戈大学)

Hugo Jair Escalante, Mauricio A. García-Limón, Alicia Morales-Reyes, Mario Graff, Manuel Montes-y-Gómez, Eduardo F. Morales

摘要:

本文描述了一种新的方法来学习的术语加权方案(TWS)的文本分类的背景下。在文本挖掘中,TWS在应用分类器之前确定文档在向量空间模型中的表示方式。尽管已经用标准TWS获得了可接受的性能(例如,布尔和术语频率方案),TWS的定义传统上是一门艺术。此外,确定什么是特定问题的最佳TWS仍然是一项艰巨的任务,并且还不清楚,是否可以通过组合已知的TWS来生成比当前可用的方案更好的方案。在这篇文章中,我们提出了一个遗传程序,旨在学习有效的TWS,可以提高目前的文本分类方案的性能。遗传程序学习如何组合一组基本单位来产生有区别的TWS。我们报告了一个广泛的实验研究,包括数据集的主题和非主题的文本分类,以及从图像分类。我们的研究表明,所提出的方法的有效性,事实上,我们表明,TWS学习的遗传程序优于传统的计划和其他TWS在最近的作品中提出的。此外,我们表明,TWS从一个特定的域可以有效地用于其他任务。

英文摘要:

This paper describes a novel approach to learning term-weighting schemes (TWSs) in the context of text classification. In text mining a TWS determines the way in which documents will be represented in a vector space model, before applying a classifier. Whereas acceptable performance has been obtained with standard TWSs (e.g., Boolean and term-frequency schemes), the definition of TWSs has been traditionally an art. Further, it is still a difficult task to determine what is the best TWS for a particular problem and it is not clear yet, whether better schemes, than those currently available, can be generated by combining known TWS. We propose in this article a genetic program that aims at learning effective TWSs that can improve the performance of current schemes in text classification. The genetic program learns how to combine a set of basic units to give rise to discriminative TWSs. We report an extensive experimental study comprising data sets from thematic and non-thematic text classification as well as from image classification. Our study shows the validity of the proposed method; in fact, we show that TWSs learned with the genetic program outperform traditional schemes and other TWSs proposed in recent works. Further, we show that TWSs learned from a specific domain can be effectively used for other tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑