arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.04680cs.IRcs.LG
收藏

情感分类的抽象性约简:最显著和可分离特征的演化

Dimensionality Reduction for Sentiment Classification: Evolving for the Most Prominent and Separable Features

University of Jinan(济南大学)

Aftab Anjum, Mazharul Islam, Lin Wang

摘要:

在情感分类中,大量的文本数据,其巨大的维度和固有的噪声使得机器学习分类器非常难以提取高级和复杂的抽象。为了使数据更稀疏,更具有统计意义,需要降维技术。但在现有的降维技术中,由于需要人工设置分量个数,导致最突出的特征丢失,从而降低了分类器的性能。我们之前的工作,即,术语存在计数(TPC)和术语存在比率(TPR)已被证明是有效的技术,因为它们拒绝了分离度较低的特征。然而,最突出和可分离的特征仍然可能从初始特征集中移除,尽管在正标记文档和负标记文档中具有较高的分布。为了克服这个问题,我们提出了一个新的框架,该框架包括二维缩减技术,即,情绪术语存在计数(SentiTPC)和情绪术语存在比率(SentiTPR)。这些技术通过考虑SentiTPC的术语存在差异和SentiTPR的分布差异的比率来拒绝特征。此外,这些方法还分析总分布信息。大量的实验结果表明,所提出的框架降低了大规模的特征维数,从而显着提高分类性能。

英文摘要:

In sentiment classification, the enormous amount of textual data, its immense dimensionality, and inherent noise make it extremely difficult for machine learning classifiers to extract high-level and complex abstractions. In order to make the data less sparse and more statistically significant, the dimensionality reduction techniques are needed. But in the existing dimensionality reduction techniques, the number of components needs to be set manually which results in loss of the most prominent features, thus reducing the performance of the classifiers. Our prior work, i.e., Term Presence Count (TPC) and Term Presence Ratio (TPR) have proven to be effective techniques as they reject the less separable features. However, the most prominent and separable features might still get removed from the initial feature set despite having higher distributions among positive and negative tagged documents. To overcome this problem, we have proposed a new framework that consists of two-dimensionality reduction techniques i.e., Sentiment Term Presence Count (SentiTPC) and Sentiment Term Presence Ratio (SentiTPR). These techniques reject the features by considering term presence difference for SentiTPC and ratio of the distribution distinction for SentiTPR. Additionally, these methods also analyze the total distribution information. Extensive experimental results exhibit that the proposed framework reduces the feature dimension by a large scale, and thus significantly improve the classification performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑