arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.14454cs.CL
收藏

SOLID:一个用于攻击性语言识别的大规模半监督数据集

SOLID: A Large-Scale Semi-Supervised Dataset for Offensive Language Identification

IBM Research(IBM研究);University of Copenhagen(哥本哈根大学);University of Cambridge(剑桥大学);Rochester Institute of Technology(罗切斯特理工学院);Qatar Computing Research Institute, HBKU(卡塔尔计算研究学院,哈马德·本·哈利法大学)

Sara Rosenthal, Pepa Atanasova, Georgi Karadzhov, Marcos Zampieri, Preslav Nakov

摘要:

社交媒体中攻击性内容的广泛使用导致了大量关于检测仇恨言论、网络欺凌和网络攻击等语言的研究。最近的工作提出了OLID数据集,它遵循攻击性语言识别的分类法,为理解攻击性消息的类型和目标提供了有意义的信息。然而,它的大小有限,并且可能偏向于攻击性语言,因为它是使用关键字收集的。在这项工作中,我们提出了SOLID,一个扩展的数据集,其中的推文是以更有原则的方式收集的。SOLID包含超过900万条以半监督方式标记的英文推文。我们证明了使用SOLID和OLID在两个不同模型的OLID测试集上产生了相当大的性能增益,特别是对于较低级别的分类法。

英文摘要:

The widespread use of offensive content in social media has led to an abundance of research in detecting language such as hate speech, cyberbullying, and cyber-aggression. Recent work presented the OLID dataset, which follows a taxonomy for offensive language identification that provides meaningful information for understanding the type and the target of offensive messages. However, it is limited in size and it might be biased towards offensive language as it was collected using keywords. In this work, we present SOLID, an expanded dataset, where the tweets were collected in a more principled manner. SOLID contains over nine million English tweets labeled in a semi-supervised fashion. We demonstrate that using SOLID along with OLID yields sizable performance gains on the OLID test set for two different models, especially for the lower levels of the taxonomy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑