再探统计显著性
Statistical significance revisited
AI总结:
本文研究随机实验达到给定统计显著性所需的重复次数,在药物测试中纳入安慰剂疗效的概率分布,发现所需实验数可能翻倍,并讨论一般分布及肥尾解释中的错误假设。
摘要:
统计显著性衡量从随机实验中获得的结果的可靠性。我们研究了使一个统计结果具有某种显著性所需的重复次数。第一步,我们以安慰剂疗效固定的药物测试为例,考察二项分布变量,询问需要进行多少次实验才能达到95%的显著性。下一步,我们将安慰剂疗效的概率分布纳入考虑;据我们所知,此前尚无研究这样做。根据具体情况,我们表明,为了获得相同的显著性,可能需要进行的实验次数是忽略安慰剂分布情形下的两倍。随后,我们进一步考察更一般的概率分布,并在结尾对一些关于概率分布的错误假设加以评论,这些错误假设会导致例如对肥尾的平庸解释。
英文摘要:
Statistical significance measures the reliability of a result obtained from a random experiment. We investigate the number of repetitions needed for a statistical result to have a certain significance. In the first step, we consider binomially distributed variables in the example of medication testing with fixed placebo efficacy, asking how many experiments are needed in order to achieve a significance of 95 %. In the next step, we take the probability distribution of the placebo efficacy into account, which to the best of our knowledge has not been done so far. Depending on the specifics, we show that in order to obtain identical significance, it may be necessary to perform twice as many experiments than in a setting where the placebo distribution is neglected. We proceed by considering more general probability distributions and close with comments on some erroneous assumptions on probability distributions which lead, for instance, to a trivial explanation of the fat tail.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。