arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.04446cs.CLcs.AI
收藏

促进中文有害语言的细粒度检测:层次化分类体系、资源与基准

Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks

Dalian University of Technology(大连理工大学)

Junyu Lu, Bo Xu, Xiaokun Zhang, Changrong Min, Liang Yang, Hongfei Lin

AI总结:

本文构建了层次化有害分类体系、细粒度数据集ToxiCN及侮辱性词汇表,提出融合词汇特征的有害知识增强基准TKE,有效促进中文有害语言的细粒度检测。

摘要:

有害网络帖子的广泛传播对社会造成的危害日益严重。然而,针对中文有害语言检测的研究却明显滞后。现有数据集缺乏对有害类型和表达方式的细粒度标注,并且忽略了具有间接有害性的样本。此外,引入词汇知识来检测帖子的有害性至关重要,这一直是研究人员面临的挑战。在本文中,我们促进了中文有害语言的细粒度检测。首先,我们构建了“监控有害框架”(Monitor Toxic Frame),这是一个用于分析有害类型和表达方式的层次化分类体系。然后,我们提出了一个细粒度数据集 ToxiCN,其中包含直接和间接有害样本。我们还构建了一个包含隐式脏话的侮辱性词汇表,并提出了“有害知识增强”(Toxic Knowledge Enhancement,TKE)作为基准,该基准融合词汇特征来检测有害语言。在实验阶段,我们证明了 TKE 的有效性。之后,我们对研究结果进行了系统性的定量和定性分析。

英文摘要:

The widespread dissemination of toxic online posts is increasingly damaging to society. However, research on detecting toxic language in Chinese has lagged significantly. Existing datasets lack fine-grained annotation of toxic types and expressions, and ignore the samples with indirect toxicity. In addition, it is crucial to introduce lexical knowledge to detect the toxicity of posts, which has been a challenge for researchers. In this paper, we facilitate the fine-grained detection of Chinese toxic language. First, we built Monitor Toxic Frame, a hierarchical taxonomy to analyze toxic types and expressions. Then, a fine-grained dataset ToxiCN is presented, including both direct and indirect toxic samples. We also build an insult lexicon containing implicit profanity and propose Toxic Knowledge Enhancement (TKE) as a benchmark, incorporating the lexical feature to detect toxic language. In the experimental stage, we demonstrate the effectiveness of TKE. After that, a systematic quantitative and qualitative analysis of the findings is given.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑