arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1706.07912cs.IRcs.CL
收藏

基于聚类的倾斜文本分类符号表示

Cluster Based Symbolic Representation for Skewed Text Categorization

University of Mysore(迈索尔大学)

Lavanya Narayana Raju, Mahamad Suhil, D S Guru, Harsha S Gowda

摘要:

在这项工作中,与不平衡的文本语料库的问题得到解决。提出了一种将不平衡文本语料库转换为平衡文本语料库的方法。该方法采用聚类算法进行转换。首先,为了避免维数灾难,一个有效的表示方案的基础上的术语类相关性措施,这大大降低了在语料库中的类的数量的维数。随后,较大尺寸的类的样本被分组为若干较小尺寸的子类,以使整个语料库平衡。每个子类,然后给出一个单一的符号向量表示使用区间值的功能。这种符号表示除了紧凑之外,还有助于减少空间需求和分类时间。所提出的模型已被经验证明其优越性的基准数据集,即,路透社21578和TDT2。此外,它已与其他几个现有的当代模型,包括基于支持向量机的模型进行了比较。对比分析表明,该模型优于其他现有的模型。

英文摘要:

In this work, a problem associated with imbalanced text corpora is addressed. A method of converting an imbalanced text corpus into a balanced one is presented. The presented method employs a clustering algorithm for conversion. Initially to avoid curse of dimensionality, an effective representation scheme based on term class relevancy measure is adapted, which drastically reduces the dimension to the number of classes in the corpus. Subsequently, the samples of larger sized classes are grouped into a number of subclasses of smaller sizes to make the entire corpus balanced. Each subclass is then given a single symbolic vector representation by the use of interval valued features. This symbolic representation in addition to being compact helps in reducing the space requirement and also the classification time. The proposed model has been empirically demonstrated for its superiority on bench marking datasets viz., Reuters 21578 and TDT2. Further, it has been compared against several other existing contemporary models including model based on support vector machine. The comparative analysis indicates that the proposed model outperforms the other existing models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑