arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.13027cs.CLcs.IRcs.LG
收藏

文本处理步骤对基于词嵌入的Twitter情感分类的影响

Effect of Text Processing Steps on Twitter Sentiment Classification using Word Embedding

Tennessee State University(田纳西州立大学);Old Dominion University(欧道明大学)

Manar D. Samad, Nalin D. Khounviengxay, Megan A. Witherow

摘要:

原始文本的处理是文本分类和情感分析中至关重要的第一步。然而,文本处理步骤通常使用现成的例程和预构建的单词词典来执行,而不针对域、应用和上下文进行优化。本文研究了七种文本处理方案对特定文本域(Twitter)和应用程序(情感分类)的影响。基于跳过语法的词嵌入被开发为包括Twitter口语词、表情符号和主题标签关键词,这些关键词通常由于在传统文学语料库中不可用而被移除。我们的实验揭示了两个常见的文本处理步骤对情感分类的负面影响:1)停止词去除和2)平均词向量来表示单个推文。新的有效步骤1)包括非ASCII表情符号字符,2)从词嵌入中测量词的重要性,3)将词向量聚合到推文嵌入中,以及4)开发线性可分离的特征空间,以优化情感分类管道。文本处理步骤的最佳组合在对具有三个情感标签的14,640条推文进行分类时产生最高的平均曲线下面积(AUC)88.4(+/-0.4)。从上下文驱动的词嵌入中进行的词选择显示,只有推文中最重要的十个词累积产生超过98%的最大准确率。结果表明,数据驱动的选择的重要的话,而不是使用预先建立的单词词典的推文分类的手段。所提出的推文嵌入对几个文本处理步骤是鲁棒的,并且简化了对几个文本处理步骤的需要。

英文摘要:

Processing of raw text is the crucial first step in text classification and sentiment analysis. However, text processing steps are often performed using off-the-shelf routines and pre-built word dictionaries without optimizing for domain, application, and context. This paper investigates the effect of seven text processing scenarios on a particular text domain (Twitter) and application (sentiment classification). Skip gram-based word embeddings are developed to include Twitter colloquial words, emojis, and hashtag keywords that are often removed for being unavailable in conventional literature corpora. Our experiments reveal negative effects on sentiment classification of two common text processing steps: 1) stop word removal and 2) averaging of word vectors to represent individual tweets. New effective steps for 1) including non-ASCII emoji characters, 2) measuring word importance from word embedding, 3) aggregating word vectors into a tweet embedding, and 4) developing linearly separable feature space have been proposed to optimize the sentiment classification pipeline. The best combination of text processing steps yields the highest average area under the curve (AUC) of 88.4 (+/-0.4) in classifying 14,640 tweets with three sentiment labels. Word selection from context-driven word embedding reveals that only the ten most important words in Tweets cumulatively yield over 98% of the maximum accuracy. Results demonstrate a means for data-driven selection of important words in tweet classification as opposed to using pre-built word dictionaries. The proposed tweet embedding is robust to and alleviates the need for several text processing steps.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑