评估在包含两组以上的大规模评估中检测差异项目功能的四种方法
Evaluating Four Methods for Detecting Differential Item Functioning in Large-Scale Assessments with More Than Two Groups
AI总结:
本研究通过 Monte Carlo 模拟评估四种多组 DIF 方法,发现 RMSD 法结合模型预测截断值时 I 类错误率最佳,但用 0.1 截断值时过于保守。
摘要:
本研究通过受控测试条件的 Monte Carlo 模拟,评估了四种多组差异项目功能(DIF)方法(均方根偏差法、Wald-1、广义逻辑回归程序和广义 Mantel-Haenszel 方法)。这些条件在组数、DIF 污染组的能力和样本量、与 DIF 相关的参数以及 DIF 项目的比例上有所不同。在比较各方法的 I 类错误率和功效时,我们发现 RMSD 方法在使用模型预测的截断值时产生了最佳的 I 类错误率。同时,当使用常用的 0.1 截断值时,该方法被认为过于保守。讨论了对教育研究人员和从业者的未来研究启示。
英文摘要:
This study evaluated four multi-group differential item functioning (DIF) methods (the root mean square deviation approach, Wald-1, generalized logistic regression procedure, and generalized Mantel-Haenszel method) via Monte Carlo simulation of controlled testing conditions. These conditions varied in the number of groups, the ability and sample size of the DIF-contaminated group, the parameter associated with DIF, and the proportion of DIF items. When comparing Type-I error rates and powers of the methods, we showed that the RMSD approach yielded the best Type-I error rates when it was used with model-predicted cutoff values. Also, this approach was found to be overly conservative when used with the commonly used cutoff value of 0.1. Implications for future research for educational researchers and practitioners were discussed.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。