arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.12840cs.CL
收藏

基于词典的文本极性情感分析及分类模型评估

Lexicon-Based Sentiment Analysis on Text Polarities with Evaluation of Classification Models

Mirpur University of Science and Technology(米尔布尔科技大学)

Muhammad Raees, Samina Fazilat

AI总结:

本文采用基于词典的方法(Text Blob和Vader)对160万条推文进行多类情感分析,并评估五种机器学习模型,随机森林以81%准确率最优,同时应用于人格判断案例。

摘要:

情感分析在数字平台上具有广泛的应用潜力。情感分析提取极性以理解文本中的强度和主观性。本研究采用基于词典的方法进行情感分析,并展示了在文本数据上训练的分类模型的评估结果。基于词典的方法在单词级别识别情感的强度和主观性。分类过程识别文本中的信息性词汇,并指定单词极性的定量排名。本研究基于一个多类问题,将文本标记为正面、负面或中性。使用包含160万条未处理推文的Twitter情感数据集,结合Text Blob和Vader Sentiment等基于词典的方法,引入文本的中性度量。词典分析展示了单词数量和强度如何对文本进行分类。对机器学习模型(朴素贝叶斯、支持向量机、多项逻辑回归、随机森林和极限梯度提升(XG Boost))进行了跨多个性能指标的比较分析。随机森林取得了最佳估计,准确率达到81%。此外,情感分析还被应用于一个基于在线活动的Twitter个人资料的人格判断案例。

英文摘要:

Sentiment analysis possesses the potential of diverse applicability on digital platforms. Sentiment analysis extracts the polarity to understand the intensity and subjectivity in the text. This work uses a lexicon-based method to perform sentiment analysis and shows an evaluation of classification models trained over textual data. The lexicon-based methods identify the intensity of emotion and subjectivity at word levels. The categorization identifies the informative words inside a text and specifies the quantitative ranking of the polarity of words. This work is based on a multi-class problem of text being labeled as positive, negative, or neutral. Twitter sentiment dataset containing 1.6 million unprocessed tweets is used with lexicon-based methods like Text Blob and Vader Sentiment to introduce the neutrality measure on text. The analysis of lexicons shows how the word count and the intensity classify the text. A comparative analysis of machine learning models, Naiive Bayes, Support Vector Machines, Multinomial Logistic Regression, Random Forest, and Extreme Gradient (XG) Boost performed across multiple performance metrics. The best estimations are achieved through Random Forest with an accuracy score of 81%. Additionally, sentiment analysis is applied for a personality judgment case against a Twitter profile based on online activity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑