触发器:为FanFiction引导暴力检测器
Trigger Warnings: Bootstrapping a Violence Detector for FanFiction
摘要:
我们提出了第一个数据集和评估结果的一个新定义的计算任务的触发警告分配。标注语料库数据来自于著名同人小说网站Archive of Our Own(AO 3)上的叙事作品。在本文中,我们专注于最频繁分配的触发类型-暴力-并定义了一个文档级的二元分类任务,即是否将暴力触发警告分配给同人小说,利用AO 3作者提供的警告标签。SVM和BERT模型在我们编译的语料库上的四个评估设置中进行训练,产生$F_1$结果,范围从0.585到0.798,证明暴力触发警告分配是一个可行的,但是,不平凡的任务。
英文摘要:
We present the first dataset and evaluation results on a newly defined computational task of trigger warning assignment. Labeled corpus data has been compiled from narrative works hosted on Archive of Our Own (AO3), a well-known fanfiction site. In this paper, we focus on the most frequently assigned trigger type--violence--and define a document-level binary classification task of whether or not to assign a violence trigger warning to a fanfiction, exploiting warning labels provided by AO3 authors. SVM and BERT models trained in four evaluation setups on the corpora we compiled yield $F_1$ results ranging from 0.585 to 0.798, proving the violence trigger warning assignment to be a doable, however, non-trivial task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。