乌克兰语中的毒性分类
Toxicity Classification in Ukrainian
AI总结:
针对乌克兰语缺乏毒性分类语料库的问题,本研究通过翻译、关键词过滤和众包标注创建带标签语料库,并比较了LLMs提示等跨语言转移方法,为最稳健高效的基线提供见解。
摘要:
毒性检测任务仍然是一项相关任务,特别是在安全和公平的LMs开发背景下。然而,并非所有语言都有带标签的二分类毒性分类语料库,考虑到标注过程的资源密集型性质,这是可以理解的。特别是乌克兰语,就是缺乏此类资源的语言之一。据我们所知,目前尚不存在乌克兰语的毒性分类语料库。在本研究中,我们旨在通过研究跨语言知识转移技术并通过以下方式创建带标签的语料库来填补这一空白:从英语语料库翻译,使用关键词过滤毒性样本,以及通过众包进行标注。我们比较了LLMs提示和其他跨语言转移方法(包含和不包含微调),为最稳健和高效的基线提供了见解。
英文摘要:
The task of toxicity detection is still a relevant task, especially in the context of safe and fair LMs development. Nevertheless, labeled binary toxicity classification corpora are not available for all languages, which is understandable given the resource-intensive nature of the annotation process. Ukrainian, in particular, is among the languages lacking such resources. To our knowledge, there has been no existing toxicity classification corpus in Ukrainian. In this study, we aim to fill this gap by investigating cross-lingual knowledge transfer techniques and creating labeled corpora by: (i)~translating from an English corpus, (ii)~filtering toxic samples using keywords, and (iii)~annotating with crowdsourcing. We compare LLMs prompting and other cross-lingual transfer approaches with and without fine-tuning offering insights into the most robust and efficient baselines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。