arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.01063cs.CLcs.AI
收藏

机器学习和深度学习算法在网络仇恨语音检测中的对比分析

Comparative Analysis of Machine Learning and Deep Learning Algorithms for Detection of Online Hate Speech

Delhi Technological University(德里理工大学)

Tashvik Dhamija, Anjum, Rahul Katarya

摘要:

在社交媒体时代,用户很容易在网上发表仇恨言论。已经进行了几次尝试来使用机器学习对仇恨言论进行分类,但是最先进的模型对于实际应用来说不够鲁棒。这归功于原始NLP特征工程技术的使用。在本文中,我们探讨了各种特征工程技术,从不同的嵌入到传统的NLP算法。我们还尝试了不同功能的组合。从我们的实验中,我们意识到,roBERTa(鲁棒优化的BERT方法)基于句子嵌入分类使用决策树给出了0.9998 F1得分的最佳结果。在我们的论文中,我们得出结论,BERT为基础的嵌入给这个问题的最有用的功能,并有能力成为一个实用的鲁棒模型。

英文摘要:

In the day and age of social media, users have become prone to online hate speech. Several attempts have been made to classify hate speech using machine learning but the state-of-the-art models are not robust enough for practical applications. This is attributed to the use of primitive NLP feature engineering techniques. In this paper, we explored various feature engineering techniques ranging from different embeddings to conventional NLP algorithms. We also experimented with combinations of different features. From our experimentation, we realized that roBERTa (robustly optimized BERT approach) based sentence embeddings classified using decision trees gives the best results of 0.9998 F1 score. In our paper, we concluded that BERT based embeddings give the most useful features for this problem and have the capacity to be made into a practical robust model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑