arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.00813cs.CLcs.AIcs.LG
收藏

NLP模式中的社会偏见对残疾人的障碍

Social Biases in NLP Models as Barriers for Persons with Disabilities

Google(谷歌)

Ben Hutchinson, Vinodkumar Prabhakaran, Emily Denton, Kellie Webster, Yu Zhong, Stephen Denuyl

摘要:

建立公平和包容的NLP技术需要考虑社会态度是否以及如何在ML模型中表示。特别是,模型中编码的表示往往会无意中使训练数据中不受欢迎的社会偏见永久化。在本文中,我们提出的证据,这种不良的偏见提到残疾在两个不同的英语语言模型:毒性预测和情感分析。接下来,我们证明了神经嵌入是大多数NLP管道中关键的第一步,同样包含对残疾提及的不良偏见。最后,我们强调了主题偏见的话语残疾,这可能有助于观察到的模型偏见;例如,枪支暴力,无家可归,吸毒成瘾是过度的文本中讨论精神疾病。

英文摘要:

Building equitable and inclusive NLP technologies demands consideration of whether and how social attitudes are represented in ML models. In particular, representations encoded in models often inadvertently perpetuate undesirable social biases from the data on which they are trained. In this paper, we present evidence of such undesirable biases towards mentions of disability in two different English language models: toxicity prediction and sentiment analysis. Next, we demonstrate that the neural embeddings that are the critical first step in most NLP pipelines similarly contain undesirable biases towards mentions of disability. We end by highlighting topical biases in the discourse about disability which may contribute to the observed model biases; for instance, gun violence, homelessness, and drug addiction are over-represented in texts discussing mental illness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑