一种用于检测差异项目功能的非参数贝叶斯模型:在美国政治代表性中的应用
A Non-parametric Bayesian Model for Detecting Differential Item Functioning: An Application to Political Representation in the US
AI总结:
本文提出在IRT模型中引入狄利克雷过程先验以自动检测差异项目功能,并通过对美国选民与立法者唱名表决偏好数据的分析,发现部分选民的潜在偏好与立法者不可直接比较,忽视该问题会误导政治代表性质量的判断。
摘要:
研究代表质量时,一种常见方法涉及比较选民和立法者的潜在偏好,这些偏好通常通过将项目反应理论(IRT)模型拟合到一组共同刺激上来获得。尽管暴露于相同的刺激,选民和立法者可能对这些刺激如何映射到其潜在偏好上并不共享共同的理解,从而导致差异项目功能(DIF)和估计值的不可比性。我们通过重新分析一个有影响力的调查数据集来探索通过IRT模型获得的潜在偏好中DIF和不可比性的存在,在该数据集中,调查受访者表达了他们对美国立法者此前已投票过的唱名表决的偏好。为此,我们提出在标准IRT模型中对项目反应函数定义一个狄利克雷过程先验。与检测DIF的典型多步骤方法相比,我们的策略允许研究者拟合单一模型,自动识别具有从潜在特质到观测反应的不同映射的不可比子群体。我们发现,尽管存在一组选民的估计位置可以安全地与立法者的位置进行比较,但相当大比例的受访选民以根本不同的方式理解刺激。忽视这些问题可能导致关于代表质量的错误结论。
英文摘要:
A common approach when studying the quality of representation involves comparing the latent preferences of voters and legislators, commonly obtained by fitting an item-response theory (IRT) model to a common set of stimuli. Despite being exposed to the same stimuli, voters and legislators may not share a common understanding of how these stimuli map onto their latent preferences, leading to differential item-functioning (DIF) and incomparability of estimates. We explore the presence of DIF and incomparability of latent preferences obtained through IRT models by re-analyzing an influential survey data set, where survey respondents expressed their preferences on roll call votes that U.S. legislators had previously voted on. To do so, we propose defining a Dirichlet Process prior over item-response functions in standard IRT models. In contrast to typical multi-step approaches to detecting DIF, our strategy allows researchers to fit a single model, automatically identifying incomparable sub-groups with different mappings from latent traits onto observed responses. We find that although there is a group of voters whose estimated positions can be safely compared to those of legislators, a sizeable share of surveyed voters understand stimuli in fundamentally different ways. Ignoring these issues can lead to incorrect conclusions about the quality of representation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。