WEIRD ICWSM:社会计算研究在多大程度上是西方的、受过教育的、工业化的、富裕的和民主的?
WEIRD ICWSM: How Western, Educated, Industrialized, Rich, and Democratic is Social Computing Research?
AI总结:
本文分析2018–2022年 ICWSM 的420篇论文并改造 WEIRD 指标,发现其数据来源较 CHI 和 FAccT 更多元,但仍偏向高教育、工业化和富裕国家。
摘要:
社会计算领域的许多研究分析来自社交媒体平台的数据,而这些数据可能固有地带有偏见。此类偏见一个被忽视的来源是 WEIRD(西方的、受过教育的、工业化的、富裕的和民主的)人群的过度代表,这可能无法准确反映全球人口多样性。我们评估了 AAAI ICWSM 会议所呈现研究对 WEIRD 人群的依赖;该会议是唯一一种论文集完全致力于社会计算研究的发表渠道。为此,我们分析了2018年至2022年发表的494篇论文,包括完整研究论文、数据集论文和海报。在剔除分析合成数据集或缺乏明确来源国的论文后,剩余420篇论文;一项众包研究中的188名参与者在经过完整人工验证的情况下,从这些论文中提取数据,用于计算 WEIRD 分数。随后,这些数据被用于调整现有 WEIRD 指标,使其适用于社交媒体数据。我们发现,这些论文中有37%仅关注来自西方国家的数据。这一比例显著低于 CHI(76%)和 FAccT(84%)会议研究中观察到的比例,表明 ICWSM 的数据集来源具有更高多样性。然而,与 FAccT 相比,ICWSM 的研究仍然主要考察来自受教育程度、工业化程度和富裕程度更高国家的人群;同时需要特别指出,“民主”变量反映的是政治自由和权利。这表明社交媒体数据可用于揭示来自政治自由受限国家的研究发现。基于这些洞见,我们建议扩展当前的“论文检查清单”,将对 WEIRD 偏见的考量纳入其中,并呼吁社群通过鼓励使用来自代表性不足地区的多样化数据集来拓宽研究包容性。
英文摘要:
Much of the research in social computing analyzes data from social media platforms, which may inherently carry biases. An overlooked source of such bias is the over-representation of WEIRD (Western, Educated, Industrialized, Rich, and Democratic) populations, which might not accurately mirror the global demographic diversity. We evaluated the dependence on WEIRD populations in research presented at the AAAI ICWSM conference; the only venue whose proceedings are fully dedicated to social computing research. We did so by analyzing 494 papers published from 2018 to 2022, which included full research papers, dataset papers and posters. After filtering out papers that analyze synthetic datasets or those lacking clear country of origin, we were left with 420 papers from which 188 participants in a crowdsourcing study with full manual validation extracted data for the WEIRD scores computation. This data was then used to adapt existing WEIRD metrics to be applicable for social media data. We found that 37% of these papers focused solely on data from Western countries. This percentage is significantly less than the percentages observed in research from CHI (76%) and FAccT (84%) conferences, suggesting a greater diversity of dataset origins within ICWSM. However, the studies at ICWSM still predominantly examine populations from countries that are more Educated, Industrialized, and Rich in comparison to those in FAccT, with a special note on the 'Democratic' variable reflecting political freedoms and rights. This points out the utility of social media data in shedding light on findings from countries with restricted political freedoms. Based on these insights, we recommend extensions of current "paper checklists" to include considerations about the WEIRD bias and call for the community to broaden research inclusivity by encouraging the use of diverse datasets from underrepresented regions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。