arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1504.06896stat.AP
收藏

阅读眼动标准分析中的假阳性和其他统计错误

False Positives and Other Statistical Errors in Standard Analyses of Eye Movements in Reading

Department of Psychology and Department of Linguistics, UC San Diego(加州大学圣地亚哥分校心理学系和语言学系);Department of Psychology, Bournemouth University(伯恩茅斯大学心理学系)

Titus von der Malsburg, Bernhard Angele

摘要:

在阅读中的眼动研究中,通常会分析一些典型的依赖性措施来研究操作的效果如何随着时间的推移而展开。尽管这会引起众所周知的多重比较问题,即原假设被错误拒绝(第一类错误)的概率过高,但公认的标准做法是不应用任何校正程序。相反,似乎有一种普遍的看法,认为没有必要进行纠正,因为误报的增加太小了。据我们所知,还没有正式的论据来证明这一假设。在这里,我们使用蒙特卡罗模拟报告这个问题的计算调查。我们的研究结果表明,与传统的智慧,误报增加到不可接受的水平时,没有纠正。我们的模拟还表明,像Bonferroni校正这样的反措施可以控制误报,同时仅适度降低统计功效。因此,没有什么理由不把这种修正作为一项标准要求。此外,我们还讨论了当统计功效较低时可能出现的三种统计错觉,并展示了如何提高功效以防止这些错觉。总之,我们的工作提供了一个详细的图片的各种类型的统计错误比可能发生在阅读行为的研究,我们提供了具体的指导,如何避免这些错误。

英文摘要:

In research on eye movements in reading, it is common to analyze a number of canonical dependent measures to study how the effects of a manipulation unfold over time. Although this gives rise to the well-known multiple comparisons problem, i.e. an inflated probability that the null hypothesis is incorrectly rejected (Type I error), it is accepted standard practice not to apply any correction procedures. Instead, there appears to be a widespread belief that corrections are not necessary because the increase in false positives is too small to matter. To our knowledge, no formal argument has ever been presented to justify this assumption. Here, we report a computational investigation of this issue using Monte Carlo simulations. Our results show that, contrary to conventional wisdom, false positives are increased to unacceptable levels when no corrections are applied. Our simulations also show that counter-measures like the Bonferroni correction keep false positives in check while reducing statistical power only moderately. Hence, there is little reason why such corrections should not be made a standard requirement. Further, we discuss three statistical illusions that can arise when statistical power is low, and we show how power can be improved to prevent these illusions. In sum, our work renders a detailed picture of the various types of statistical errors than can occur in studies of reading behavior and we provide concrete guidance about how these errors can be avoided.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑