arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.10535cs.CLcs.CYcs.HCcs.LG
收藏

自然语言处理的“殖民冲动”:对孟加拉语情感分析工具及其基于身份的偏见的审计

The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biases

University of Colorado Boulder(科罗拉多大学博尔德分校);University of Toronto(多伦多大学)

Dipto Das, Shion Guha, Jed Brubaker, Bryan Semaan

AI总结:

该研究审计 PyPI 和 GitHub 上的孟加拉语情感分析工具,揭示其在性别、宗教和国籍身份上的输出不一致与偏见,并联系殖民历史讨论下游影响。

摘要:

尽管殖民主义在社会历史上从多个维度影响了人们的身份,但这些殖民价值观和偏见仍继续由社会技术系统延续。情感分析工具是一类社会技术系统,也可能延续殖民价值观和偏见;然而,尽管此类工具常被用于指导多种实践(例如内容审核),它们如何可能参与延续殖民性却较少受到关注。本文中,我们在已经经历并仍在经历殖民主义影响的孟加拉语社群背景下,考察情感分析工具中的潜在偏见。基于当地孟加拉语社群中受殖民主义影响最深的身份类别,我们将分析重点放在性别、宗教和国籍上。我们对 Python 包索引(PyPI)和 GitHub 上可获得的所有孟加拉语情感分析工具进行了算法审计。分析表明,尽管语义内容和结构相似,除不同工具输出之间的不一致外,孟加拉语情感分析工具还在不同身份类别之间表现出偏见,并对不同的身份表达方式作出不同反应。通过将研究发现与孟加拉语社群中由殖民塑造的社会文化结构相联系,我们讨论了情感分析工具下游偏见的影响。

英文摘要:

While colonization has sociohistorically impacted people's identities across various dimensions, those colonial values and biases continue to be perpetuated by sociotechnical systems. One category of sociotechnical systems--sentiment analysis tools--can also perpetuate colonial values and bias, yet less attention has been paid to how such tools may be complicit in perpetuating coloniality, although they are often used to guide various practices (e.g., content moderation). In this paper, we explore potential bias in sentiment analysis tools in the context of Bengali communities that have experienced and continue to experience the impacts of colonialism. Drawing on identity categories most impacted by colonialism amongst local Bengali communities, we focused our analytic attention on gender, religion, and nationality. We conducted an algorithmic audit of all sentiment analysis tools for Bengali, available on the Python package index (PyPI) and GitHub. Despite similar semantic content and structure, our analyses showed that in addition to inconsistencies in output from different tools, Bengali sentiment analysis tools exhibit bias between different identity categories and respond differently to different ways of identity expression. Connecting our findings with colonially shaped sociocultural structures of Bengali communities, we discuss the implications of downstream bias of sentiment analysis tools.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑