arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.03529cs.CL
收藏

真值,谁的真值?--检查注释有毒文本数据集的挑战

Ground-Truth, Whose Truth? -- Examining the Challenges with Annotating Toxic Text Datasets

Lally School of Management, Rensselaer Polytechnic Institute(伦斯勒理工学院拉利管理学院);IBM Research(IBM研究院)

Kofi Arhin, Ioana Baldini, Dennis Wei, Karthikeyan Natesan Ramamurthy, Moninder Singh

摘要:

使用基于机器学习(ML)的语言模型(LM)来在线监控内容的情况正在增加。对于有毒文本识别,这些模型的任务特定的微调是使用由注释者标记的数据集执行的,注释者提供真值标签,以区分攻击性内容和正常内容。随着时间的推移,这些项目导致了大型数据集的开发、改进和扩展,并为自然语言的研究做出了巨大贡献。尽管取得了这些成就,但现有的证据表明,基于这些数据集构建的ML模型并不总是产生理想的结果。因此,使用设计科学研究(DSR)的方法,本研究检查了选定的有毒文本数据集,目的是揭示一些固有的问题,并有助于讨论如何应对现有和未来项目的挑战。为了实现这项研究的目标,我们重新注释样本从三个有毒文本数据集,发现一个多标签的方法来注释有毒文本样本可以帮助提高数据集的质量。虽然这种方法可能不会改善传统的注释者间协议的度量,但它可以更好地捕获对上下文的依赖性和注释者的多样性。我们讨论了这些结果的理论和实践的影响。

英文摘要:

The use of machine learning (ML)-based language models (LMs) to monitor content online is on the rise. For toxic text identification, task-specific fine-tuning of these models are performed using datasets labeled by annotators who provide ground-truth labels in an effort to distinguish between offensive and normal content. These projects have led to the development, improvement, and expansion of large datasets over time, and have contributed immensely to research on natural language. Despite the achievements, existing evidence suggests that ML models built on these datasets do not always result in desirable outcomes. Therefore, using a design science research (DSR) approach, this study examines selected toxic text datasets with the goal of shedding light on some of the inherent issues and contributing to discussions on navigating these challenges for existing and future projects. To achieve the goal of the study, we re-annotate samples from three toxic text datasets and find that a multi-label approach to annotating toxic text samples can help to improve dataset quality. While this approach may not improve the traditional metric of inter-annotator agreement, it may better capture dependence on context and diversity in annotators. We discuss the implications of these results for both theory and practice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑