arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.06990cs.NEcs.AIcs.CLstat.ML
收藏

基于进化算法的情感分析文本压缩

Text Compression for Sentiment Analysis via Evolutionary Algorithms

University of Cape Town(开普敦大学);African Institute for Mathematical Sciences(非洲数学科学研究院);South African Astronomical Observatory(南非天文台)

Emmanuel Dufourq, Bruce A. Bassett

摘要:

文本数据可以被智能地压缩而不损失评估情感的准确性吗?在本研究中,我们提出了一种新型的进化压缩算法PARSEC(PARts-of-Speech for sEntiment Compression),该算法利用词性标签来压缩文本,在与情感分析算法结合使用时,牺牲了最小的分类准确性。对12个英语情感数据集的八种商业和非商业情感分析算法的PARSEC的分析揭示,使用LingPipe(最准确的情感算法)的PARSEC的数据压缩的(20%,50%,75%)情感分类准确度损失(0%,1.3%,3.3%)的精确压缩是可能的。其他情感分析算法受到压缩的影响更严重。我们的结论是,显着的压缩文本数据是可能的情感分析取决于特定的应用程序和特定的情感分析算法使用的准确性要求。

英文摘要:

Can textual data be compressed intelligently without losing accuracy in evaluating sentiment? In this study, we propose a novel evolutionary compression algorithm, PARSEC (PARts-of-Speech for sEntiment Compression), which makes use of Parts-of-Speech tags to compress text in a way that sacrifices minimal classification accuracy when used in conjunction with sentiment analysis algorithms. An analysis of PARSEC with eight commercial and non-commercial sentiment analysis algorithms on twelve English sentiment data sets reveals that accurate compression is possible with (0%, 1.3%, 3.3%) loss in sentiment classification accuracy for (20%, 50%, 75%) data compression with PARSEC using LingPipe, the most accurate of the sentiment algorithms. Other sentiment analysis algorithms are more severely affected by compression. We conclude that significant compression of text data is possible for sentiment analysis depending on the accuracy demands of the specific application and the specific sentiment analysis algorithm used.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑