arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.07807cs.CLcs.LGstat.ML

Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Network

Fraunhofer FIT(弗劳恩霍夫应用信息技术研究所);RWTH Aachen University(亚琛工业大学);Insight SFI Research Centre for Data Analytics(Insight SFI数据分析研究中心);Data Science Institute(数据科学研究所);National University of Ireland Galway(爱尔兰国立大学戈尔韦分校);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学)

Md. Rezaul Karim, Bharathi Raja Chakravarthi, John P. McCrae, Michael Cochez

英文摘要:

Exponential growths of social media and micro-blogging sites not only provide platforms for empowering freedom of expressions and individual voices but also enables people to express anti-social behaviour like online harassment, cyberbullying, and hate speech. Numerous works have been proposed to utilize these data for social and anti-social behaviours analysis, document characterization, and sentiment analysis by predicting the contexts mostly for highly resourced languages such as English. However, there are languages that are under-resources, e.g., South Asian languages like Bengali, Tamil, Assamese, Telugu that lack of computational resources for the NLP tasks. In this paper, we provide several classification benchmarks for Bengali, an under-resourced language. We prepared three datasets of expressing hate, commonly used topics, and opinions for hate speech detection, document classification, and sentiment analysis, respectively. We built the largest Bengali word embedding models to date based on 250 million articles, which we call BengFastText. We perform three different experiments, covering document classification, sentiment analysis, and hate speech detection. We incorporate word embeddings into a Multichannel Convolutional-LSTM (MConv-LSTM) network for predicting different types of hate speech, document classification, and sentiment analysis. Experiments demonstrate that BengFastText can capture the semantics of words from respective contexts correctly. Evaluations against several baseline embedding models, e.g., Word2Vec and GloVe yield up to 92.30%, 82.25%, and 90.45% F1-scores in case of document classification, sentiment analysis, and hate speech detection, respectively during 5-fold cross-validation tests.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑