arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.00347cs.CLcs.AI
收藏

解锁偏见检测:利用基于Transformer的模型进行内容分析

Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysis

Vector Institute(向量研究所);University of Mysore(迈索尔大学)

Shaina Raza, Oluwanifemi Bamgbose, Veronica Chatrath, Shardul Ghuge, Yan Sidyakin, Abdullah Y Muaad

AI总结:

针对传统语言模型偏见检测泛化性差、多聚焦句子级单任务的问题,提出融合上下文与实体Transformer的CBDT分类器,制备专用数据集,实验验证其在偏见识别与定位上的有效性,并公开标注数据集。

摘要:

文本中的偏见检测对于遏制负面刻板印象、错误信息的传播以及有偏见的决策至关重要。传统语言模型通常难以在训练数据之外实现泛化,且一般为单一任务设计,往往聚焦于句子层面的偏见检测。为解决这一问题,我们提出了Contextualized Bi-Directional Dual Transformer(CBDT,上下文双向双Transformer)分类器。该模型融合了两个互补的Transformer网络:Context Transformer(上下文Transformer)与Entity Transformer(实体Transformer),重点提升偏见检测能力。我们专门制备了一个数据集用于训练这些模型,以识别和定位文本中的偏见。我们在多个数据集上的评估表明,CBDT在区分有偏见的叙述与中立叙述、识别特定偏见术语方面表现出色。这项工作为CBDT模型应用于各类语言和文化场景铺平了道路,提升了其在偏见检测工作中的实用性。我们还公开了带标注的数据集以供研究使用。

英文摘要:

Bias detection in text is crucial for combating the spread of negative stereotypes, misinformation, and biased decision-making. Traditional language models frequently face challenges in generalizing beyond their training data and are typically designed for a single task, often focusing on bias detection at the sentence level. To address this, we present the Contextualized Bi-Directional Dual Transformer (CBDT) \textcolor{green}{\faLeaf} classifier. This model combines two complementary transformer networks: the Context Transformer and the Entity Transformer, with a focus on improving bias detection capabilities. We have prepared a dataset specifically for training these models to identify and locate biases in texts. Our evaluations across various datasets demonstrate CBDT \textcolor{green} effectiveness in distinguishing biased narratives from neutral ones and identifying specific biased terms. This work paves the way for applying the CBDT \textcolor{green} model in various linguistic and cultural contexts, enhancing its utility in bias detection efforts. We also make the annotated dataset available for research purposes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑