若有触发警告,触发点在哪里?段落层面的触发警告研究
If there's a Trigger Warning, then where's the Trigger? Investigating Trigger Warnings at the Passage Level
AI总结:
该研究首次探究从文档中识别触发段落的可行性,构建了含4135个英文段落的多类别触发标注数据集,评估了微调与少样本分类器的效果,证实自动触发分类虽具挑战但可行。
摘要:
触发警告是标注在含敏感内容文档前的标签,用于提示该内容可能会被特定读者群体视为有害。由于文档警告按常理需要在阅读前展示,作者通常在文档层面标注触发警告,但目前尚不清楚是文本的哪些部分促使他们添加了警告。我们首次通过人工和计算两种方式,探究识别文档中触发段落的可行性。我们构建了一个包含4135个英文段落的数据集,每个段落都标注了八种常见触发警告中的一种。在大规模评估中,我们系统测试了微调分类器和少样本分类器的效果及其泛化能力。研究发现,触发标注属于自然语言处理(NLP)中的主观标注任务,自动触发分类仍具挑战性但具备可行性。
英文摘要:
Trigger warnings are labels that preface documents with sensitive content if this content could be perceived as harmful by certain groups of readers. Since warnings about a document intuitively need to be shown before reading it, authors usually assign trigger warnings at the document level. What parts of their writing prompted them to assign a warning, however, remains unclear. We investigate for the first time the feasibility of identifying the triggering passages of a document, both manually and computationally. We create a dataset of 4,135 English passages, each annotated with one of eight common trigger warnings. In a large-scale evaluation, we then systematically evaluate the effectiveness of fine-tuned and few-shot classifiers, and their generalizability. We find that trigger annotation belongs to the group of subjective annotation tasks in NLP, and that automatic trigger classification remains challenging but feasible.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。