arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.01334cs.CY
收藏

性别刻板印象强化:测量排名算法传达的性别偏见

Gender Stereotype Reinforcement: Measuring the Gender Bias Conveyed by Ranking Algorithms

Alessandro Fabris, Alberto Purpura, Gianmaria Silvello, Gian Antonio Susto

摘要:

搜索引擎(SE)已被证明延续了心理学文献中确定的众所周知的性别陈规定型观念,并相应地影响用户。从大型在线语料库中学习到的词嵌入(WEs)中也发现了类似的偏见。在这种情况下,我们提出了性别刻板印象强化(GSR)措施,它量化的倾向,SE支持性别刻板印象,利用性别相关的信息编码在WE。通过结构效度的关键镜头,我们验证了合成和真实集合的建议措施。随后,我们使用GSR比较广泛使用的信息检索排名算法,包括词汇,语义和神经模型。我们检查基于WEs的排名算法是否以及如何继承底层嵌入的偏差。我们还考虑了文献中提出的WEs最常见的去偏置方法,并测试了它们在GSR和常见性能指标方面的影响。据我们所知,GSR是第一个专门为IR量身定制的措施,能够量化代表性伤害。

英文摘要:

Search Engines (SE) have been shown to perpetuate well-known gender stereotypes identified in psychology literature and to influence users accordingly. Similar biases were found encoded in Word Embeddings (WEs) learned from large online corpora. In this context, we propose the Gender Stereotype Reinforcement (GSR) measure, which quantifies the tendency of a SE to support gender stereotypes, leveraging gender-related information encoded in WEs. Through the critical lens of construct validity, we validate the proposed measure on synthetic and real collections. Subsequently, we use GSR to compare widely-used Information Retrieval ranking algorithms, including lexical, semantic, and neural models. We check if and how ranking algorithms based on WEs inherit the biases of the underlying embeddings. We also consider the most common debiasing approaches for WEs proposed in the literature and test their impact in terms of GSR and common performance measures. To the best of our knowledge, GSR is the first specifically tailored measure for IR, capable of quantifying representational harms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑