arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.12149cs.CL
收藏

语码混合社交媒体文本的情感分析

Sentiment Analysis of Code-Mixed Social Media Text (Hinglish)

University of Leeds(利兹大学)

Gaurav Singh

摘要:

本文讨论了不同的技术应用于执行情感分析的社会媒体(Twitter)代码混合的文本写在印度式英语的结果。执行情感分析所涉及的各个阶段是数据整合、数据清理、数据转换和建模。应用了各种数据清理技术,在五次迭代中清理数据,并在每次迭代后记录实验结果。使用count vectorizer,one hot vectorizer,tf-idf vectorizer,doc 2 vec,word 2 vec和fasttext嵌入转换数据。使用各种机器学习算法创建模型,例如SVM、KNN、决策树、随机森林、朴素贝叶斯、逻辑回归和集成投票分类器。数据来自Codalab竞赛网站上的一项任务,该任务在Semeval-2020竞赛网站上被列为任务:9。使用F1评分(宏)评价创建的模型。最好的F1得分为69.07,使用集成投票分类器。

英文摘要:

This paper discusses the results obtained for different techniques applied for performing the sentiment analysis of social media (Twitter) code-mixed text written in Hinglish. The various stages involved in performing the sentiment analysis were data consolidation, data cleaning, data transformation and modelling. Various data cleaning techniques were applied, data was cleaned in five iterations and the results of experiments conducted were noted after each iteration. Data was transformed using count vectorizer, one hot vectorizer, tf-idf vectorizer, doc2vec, word2vec and fasttext embeddings. The models were created using various machine learning algorithms such as SVM, KNN, Decision Trees, Random Forests, Naive Bayes, Logistic Regression, and ensemble voting classifiers. The data was obtained from a task on Codalab competition website which was listed as Task:9 on the Semeval-2020 competition website. The models created were evaluated using the F1-score (macro). The best F1-score of 69.07 was achieved using ensemble voting classifier.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑