arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.09003cs.CLcs.AI
收藏

黑人对应愤怒,白人对应喜悦?探究大型预训练神经语言模型中的潜在情感偏见

Blacks is to Anger as Whites is to Joy? Understanding Latent Affective Bias in Large Pre-trained Neural Language Models

University of Calicut(卡利卡特大学);Queen’s University Belfast(贝尔法斯特女王大学);Indian Institute of Technology Palakkad(巴拉卡德印度理工学院)

Anoop Kadan, Deepak P., Sahely Bhadra, Manjary P. Gangan, Lajish V. L

AI总结:

该研究针对大型预训练语言模型中的情感偏见展开探究,从语料分布与模型预测两方面量化验证了情绪与特定性别、种族、宗教存在统计显著的偏向性关联。

摘要:

基于Transformer的大型预训练语言模型(PLMs)的发展,推动了深度学习自然语言处理领域取得突破性进展与性能显著提升。人类生成的海量数据中存在大量无标注数据,结合自监督学习策略,加速了大型PLMs在语言生成、语言理解等任务上的成功。但与此同时,人类认知中针对特定性别、种族等群体的潜在历史偏见/不公,会无意或有意地编码进语料库,损害了大型PLMs在诸多实际应用中的实用性与有效性,尤其对受保护群体影响显著,也引发了相关质疑。\n本文针对大型PLMs中“情感偏见”的存在性展开广泛研究,旨在揭示在文本情感检测下游任务中,愤怒、恐惧、喜悦等情绪是否与特定性别、种族或宗教存在偏向性关联。我们从语料层面的情感偏见分析初始阶段入手,在用于PLMs预训练和微调的大规模语料中,检索特定领域内情感词的不均衡分布情况,以此探究情感偏见的来源。随后,为量化模型预测中的情感偏见,我们使用多种偏见评估语料,开展了大量基于类别与基于强度的评估实验。结果表明,基于PLM的情感检测系统中存在统计意义上显著的情感偏见,即特定情绪与特定性别、种族和宗教存在偏向性关联。

英文摘要:

Groundbreaking inventions and highly significant performance improvements in deep learning based Natural Language Processing are witnessed through the development of transformer based large Pre-trained Language Models (PLMs). The wide availability of unlabeled data within human generated data deluge along with self-supervised learning strategy helps to accelerate the success of large PLMs in language generation, language understanding, etc. But at the same time, latent historical bias/unfairness in human minds towards a particular gender, race, etc., encoded unintentionally/intentionally into the corpora harms and questions the utility and efficacy of large PLMs in many real-world applications, particularly for the protected groups. In this paper, we present an extensive investigation towards understanding the existence of "Affective Bias" in large PLMs to unveil any biased association of emotions such as anger, fear, joy, etc., towards a particular gender, race or religion with respect to the downstream task of textual emotion detection. We conduct our exploration of affective bias from the very initial stage of corpus level affective bias analysis by searching for imbalanced distribution of affective words within a domain, in large scale corpora that are used to pre-train and fine-tune PLMs. Later, to quantify affective bias in model predictions, we perform an extensive set of class-based and intensity-based evaluations using various bias evaluation corpora. Our results show the existence of statistically significant affective bias in the PLM based emotion detection systems, indicating biased association of certain emotions towards a particular gender, race, and religion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑