计算社会科学家当心:行为数据中的辛普森悖论
Computational Social Scientist Beware: Simpson's Paradox in Behavioral Data
摘要:
关于人类行为的观察数据通常是异质的,即,由研究中的群体中的亚组产生,这些亚组在大小和行为上各不相同。异质性使分析容易陷入辛普森悖论,即在整个人口中汇总的数据中观察到的趋势可能与潜在的亚组有很大的不同。我说明辛普森的悖论与几个例子来自网络行为的研究,并表明,聚合反应导致错误的结论,潜在的个人行为。然后,我提出了一个简单的方法来测试辛普森悖论是否影响分析结果。辛普森悖论在社会数据中的存在表明,重要的行为差异存在于人群中,而不考虑这些差异可能会扭曲研究结果。
英文摘要:
Observational data about human behavior is often heterogeneous, i.e., generated by subgroups within the population under study that vary in size and behavior. Heterogeneity predisposes analysis to Simpson's paradox, whereby the trends observed in data that has been aggregated over the entire population may be substantially different from those of the underlying subgroups. I illustrate Simpson's paradox with several examples coming from studies of online behavior and show that aggregate response leads to wrong conclusions about the underlying individual behavior. I then present a simple method to test whether Simpson's paradox is affecting results of analysis. The presence of Simpson's paradox in social data suggests that important behavioral differences exist within the population, and failure to take these differences into account can distort the studies' findings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。