arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.08135cs.SI
收藏

降低群体层面的不平等可改善人口统计群体公平性:一项Twitter案例研究

Reducing Population-level Inequality Can Improve Demographic Group Fairness: a Twitter Case Study

Avijit Ghosh, Tomo Lazovich, Kristian Lum, Christo Wilson

AI总结:

该研究以Twitter互动不平等为案例,发现无人口统计信息的不平等指标(如基尼系数)与人口统计群体偏差呈正相关,可作为无法直接获取人口数据时衡量群体公平性的代理指标,助力社交媒体等场景的公平性提升。

摘要:

许多现有的公平性指标衡量系统行为或模型性能中按群体划分的人口统计差异。计算这些指标需要获取人口统计信息,而在工业场景中这类信息通常无法获得。相比之下,基尼系数等经济不平等指标无需人口统计数据即可测量。不过,经济不平等程度的降低并不一定对应人口统计差异的缩小。本文针对Twitter上的互动不平等情况,实证探究了无人口统计信息的不平等指标(如基尼系数)与衡量按群体划分的模型性能差异的标准人口统计偏差指标之间的关系。我们分析了2021年全年17.4万用户的推文,发现平均情况下,无人口统计信息的曝光量不平等指标与性别、种族和年龄差异呈正相关;在最差情况下,其与人口统计偏差呈弱(但仍为正)相关。因此,我们建议将不平等指标作为平均群体差异的潜在有效代理衡量指标,尤其适用于无法直接测量此类差异的场景。基于这些结果,我们认为在社交媒体内容推荐等场景中,这些指标可作为改善人口统计群体间公平性的更广泛工作的一部分。

英文摘要:

Many existing fairness metrics measure group-wise demographic disparities in system behavior or model performance. Calculating these metrics requires access to demographic information, which, in industrial settings, is often unavailable. By contrast, economic inequality metrics, such as the Gini coefficient, require no demographic data to measure. However, reductions in economic inequality do not necessarily correspond to reductions in demographic disparities. In this paper, we empirically explore the relationship between demographic-free inequality metrics -- such as the Gini coefficient -- and standard demographic bias metrics that measure group-wise model performance disparities specifically in the case of engagement inequality on Twitter. We analyze tweets from 174K users over the duration of 2021 and find that demographic-free impression inequality metrics are positively correlated with gender, race, and age disparities in the average case, and weakly (but still positively) correlated with demographic bias in the worst case. We therefore recommend inequality metrics as a potentially useful proxy measure of average group-wise disparities, especially in cases where such disparities cannot be measured directly. Based on these results, we believe they can be used as part of broader efforts to improve fairness between demographic groups in scenarios like content recommendation on social media.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑