arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.20076cs.CL
收藏

探究半监督方法与数据增强对罗马尼亚语攻击性语言检测的影响

Investigating the Impact of Semi-Supervised Methods with Data Augmentation on Offensive Language Detection in Romanian Language

National University of Science and Technology POLITEHNICA Bucharest(布加勒斯特理工科学技术大学);National Institute for Research and Development in Informatics (ICI)(国家信息学研究与发展研究所);Academy of Romanian Scientists(罗马尼亚科学院)

Elena-Beatrice Nicola, Dumitru-Clementin Cercel, Florin Pop

AI总结:

针对罗马尼亚语攻击性语言检测中标注数据获取成本高的问题,本文研究了八种半监督方法和五种数据增强技术,实验发现部分方法能从数据增强中获得更大收益。

摘要:

在当今的数字环境中,攻击性语言检测是一项至关重要的任务,因为在线平台需要努力维持一个尊重和包容的环境。然而,构建稳健的攻击性语言检测模型需要大量的标注数据,获取这些数据既昂贵又耗时。半监督学习通过利用标注和未标注数据来创建更准确、更稳健的模型,提供了一种可行的解决方案。在本文中,我们探讨了几种不同的半监督方法以及数据增强技术。具体而言,我们实现了八种半监督方法,仅使用RO-Offense数据集中的可用数据对它们进行了实验,并在将数据输入模型之前应用了五种增强技术。实验结果表明,其中一些方法比其他方法从数据增强中获益更多。

英文摘要:

Offensive language detection is a crucial task in today's digital landscape, where online platforms grapple with maintaining a respectful and inclusive environment. However, building robust offensive language detection models requires large amounts of labeled data, which can be expensive and time-consuming to obtain. Semi-supervised learning offers a feasible solution by utilizing labeled and unlabeled data to create more accurate and robust models. In this paper, we explore a few different semi-supervised methods, as well as data augmentation techniques. Concretely, we implemented eight semi-supervised methods and ran experiments for them using only the available data in the RO-Offense dataset and applying five augmentation techniques before feeding the data to the models. Experimental results demonstrate that some of them benefit more from augmentations than others.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑