arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.09758cs.AI
收藏

多任务学习降低有害评论检测模型偏差的实证分析

Empirical Analysis of Multi-Task Learning for Reducing Model Bias in Toxic Comment Detection

Bridgewater-Raritan Regional High School(布里奇沃特-拉里坦地区高中);Stevens Institute of Technology(斯蒂文斯理工学院)

Ameya Vaidya, Feng Mai, Yue Ning

摘要:

随着最近社交媒体平台上的在线对话中的毒性的上升,使用现代机器学习算法进行有毒评论检测已经成为许多在线应用的中心焦点。研究人员和公司已经开发了各种模型来识别在线对话,评论或评论中的毒性,并取得了成功。然而,许多现有的方法已经学会了不正确地将具有某些特定词汇(例如,男同性恋、女同性恋、黑人、穆斯林)的无毒评论关联为潜在的毒性来源。在本文中,我们评估了几种最先进的模型,重点是减少对这些常见攻击的身份组的模型偏见。我们提出了一个多任务学习模型与注意层,共同学习预测评论的毒性以及评论中存在的身份,以减少这种偏见。然后,我们将我们的模型与一系列浅层和深度学习模型进行比较,使用专门设计的指标来测试这些身份组中的意外模型偏差。

英文摘要:

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have developed a variety of models to identify toxicity in online conversations, reviews, or comments with mixed successes. However, many existing approaches have learned to incorrectly associate non-toxic comments that have certain trigger-words (e.g. gay, lesbian, black, muslim) as a potential source of toxicity. In this paper, we evaluate several state-of-the-art models with the specific focus of reducing model bias towards these commonly-attacked identity groups. We propose a multi-task learning model with an attention layer that jointly learns to predict the toxicity of a comment as well as the identities present in the comments in order to reduce this bias. We then compare our model to an array of shallow and deep-learning models using metrics designed especially to test for unintended model bias within these identity groups.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑