arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1609.02809cs.CL
收藏

骚扰检测:# HackHarassment数据集上的基准测试

Harassment detection: a benchmark on the #HackHarassment dataset

Intel(英特尔)

Alexei Bastidas, Edward Dixon, Chris Loo, John Ryan

摘要:

自互联网早期以来,在线骚扰或多或少都是一个问题。以前的工作已经应用了反垃圾邮件技术,如基于机器学习的文本分类(Reynolds,2011)来检测骚扰消息。然而,现有的公共数据集大小有限,标签质量参差不齐。#HackHarcourt倡议(一个由1家科技公司和非政府组织组成的联盟,致力于打击互联网上的欺凌行为)已经开始通过创建一个在规模和质量方面都优于其数据集的新数据集来解决这个问题。随着我们(#HackHarrison)完成更多轮的标记,该数据集的后续迭代将使可用样本增加至少一个数量级,从而相应提高骚扰检测的机器学习模型的质量。在本文中,我们介绍了在#HackHarrison数据集v1.0(一个新的开放数据集,我们很高兴与任何感兴趣的研究人员分享)上构建的第一个模型,作为未来研究的基准。

英文摘要:

Online harassment has been a problem to a greater or lesser extent since the early days of the internet. Previous work has applied anti-spam techniques like machine-learning based text classification (Reynolds, 2011) to detecting harassing messages. However, existing public datasets are limited in size, with labels of varying quality. The #HackHarassment initiative (an alliance of 1 tech companies and NGOs devoted to fighting bullying on the internet) has begun to address this issue by creating a new dataset superior to its predecssors in terms of both size and quality. As we (#HackHarassment) complete further rounds of labelling, later iterations of this dataset will increase the available samples by at least an order of magnitude, enabling corresponding improvements in the quality of machine learning models for harassment detection. In this paper, we introduce the first models built on the #HackHarassment dataset v1.0 (a new open dataset, which we are delighted to share with any interested researcherss) as a benchmark for future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑