arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1508.02060cs.CL
收藏

从社交网络数据生成埃及方言停用词列表

Egyptian Dialect Stopword List Generation from Social Network Data

Canadian International College(加拿大国际学院);Ain Shams University(艾因夏姆斯大学)

Walaa Medhat, Ahmed H. Yousef, Hoda Korashy

摘要:

本文提出了一种从在线社交网络(OSN)语料库中生成埃及方言(ED)停用词列表的方法。本研究旨在探讨去除ED停用词对情感分析任务的影响。之前生成的停用词列表是基于现代标准阿拉伯语(MSA)的,这不是OSN中使用的通用语言。我们已经生成了一个埃及方言的停用词列表,用于OSN语料库。我们比较文本分类的效率时,使用生成的列表与以前生成的MSA列表,并结合埃及方言列表与MSA列表。文本分类使用朴素贝叶斯和决策树分类器和两种特征选择方法,unigram和bigram。实验表明,去除ED停用词比仅使用MSA停用词列表提供更好的性能。

英文摘要:

This paper proposes a methodology for generating a stopword list from online social network (OSN) corpora in Egyptian Dialect(ED). The aim of the paper is to investigate the effect of removingED stopwords on the Sentiment Analysis (SA) task. The stopwords lists generated before were on Modern Standard Arabic (MSA) which is not the common language used in OSN. We have generated a stopword list of Egyptian dialect to be used with the OSN corpora. We compare the efficiency of text classification when using the generated list along with previously generated lists of MSA and combining the Egyptian dialect list with the MSA list. The text classification was performed using Naïve Bayes and Decision Tree classifiers and two feature selection approaches, unigram and bigram. The experiments show that removing ED stopwords give better performance than using lists of MSA stopwords only.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑