arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.07484cs.CV
收藏

深度学习方法用于分类社交媒体上的攻击性评论:机器翻译数据与现实生活数据

Deep Learning Approach for Classifying the Aggressive Comments on Social Media: Machine Translated Data Vs Real Life Data

Kennesaw State University(肯尼索州立大学);North South University(南北大学);University of Calabria(卡拉布里亚大学)

Mst Shapna Akter, Hossain Shahriar, Nova Ahmed, Alfredo Cuzzocrea

摘要:

社交媒体上的攻击性评论对人类生活产生负面影响。这种冒犯性的内容会导致抑郁和自杀相关的活动。由于网络社交日益增多,仇恨内容也越来越多。在网络欺凌、网络侵略、仇恨言论等领域进行了几项调查,大部分调查是用英语进行的。由于缺乏数据集,一些语言(印地语和孟加拉语)仍然缺乏适当的调查。本文特别研究了印地语、孟加拉语和英语数据集,以检测攻击性评论,并展示了一种生成机器翻译数据以解决数据不可用问题的新方法。使用长短期记忆模型(LSTM)、双向长短期记忆模型(BiLSTM)、LSTM-Autoencoder、word 2 vec、来自Transformers的双向编码器表示(BERT)和生成预训练Transformer(GPT-2)等模型分析了完全机器翻译的英语数据集,以观察模型在机器翻译的噪声数据集上的表现。我们比较了使用噪声数据与两个数据集的性能,例如不包含任何噪声的原始数据和包含一定量噪声数据的半噪声数据。我们使用上述模型对原始数据和半噪声数据进行了分类。为了评估模型的性能,我们使用了F1评分、准确率、精确率和召回率等评估指标。我们使用gpt 2模型对原始数据、使用BERT模型对半噪声数据以及使用BERT模型对完全机器翻译的数据实现了最高精度。由于许多语言没有适当的数据可用性,我们的方法将帮助研究人员创建用于多种分析目的的机器翻译数据集。

英文摘要:

Aggressive comments on social media negatively impact human life. Such offensive contents are responsible for depression and suicidal-related activities. Since online social networking is increasing day by day, the hate content is also increasing. Several investigations have been done on the domain of cyberbullying, cyberaggression, hate speech, etc. The majority of the inquiry has been done in the English language. Some languages (Hindi and Bangla) still lack proper investigations due to the lack of a dataset. This paper particularly worked on the Hindi, Bangla, and English datasets to detect aggressive comments and have shown a novel way of generating machine-translated data to resolve data unavailability issues. A fully machine-translated English dataset has been analyzed with the models such as the Long Short term memory model (LSTM), Bidirectional Long-short term memory model (BiLSTM), LSTM-Autoencoder, word2vec, Bidirectional Encoder Representations from Transformers (BERT), and generative pre-trained transformer (GPT-2) to make an observation on how the models perform on a machine-translated noisy dataset. We have compared the performance of using the noisy data with two more datasets such as raw data, which does not contain any noises, and semi-noisy data, which contains a certain amount of noisy data. We have classified both the raw and semi-noisy data using the aforementioned models. To evaluate the performance of the models, we have used evaluation metrics such as F1-score,accuracy, precision, and recall. We have achieved the highest accuracy on raw data using the gpt2 model, semi-noisy data using the BERT model, and fully machine-translated data using the BERT model. Since many languages do not have proper data availability, our approach will help researchers create machine-translated datasets for several analysis purposes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑