arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.08744stat.ME
收藏

稳健使用贝叶斯因子的工作流技术

Workflow Techniques for the Robust Use of Bayes Factors

Daniel J. Schad, Bruno Nicenboim, Paul-Christian Bürkner, Michael Betancourt, Shravan Vasishth

摘要:

关于假说的推论在认知科学中无处不在。贝叶斯因子提供了一种通过与观测数据的相容性来比较不同假设的通用方法。然后,这些量化也可以用于在假设之间进行选择。虽然贝叶斯因子为假设检验提供了一种直接的方法,但它们对数据/模型假设的细节高度敏感。此外,目前还不清楚这种方法在实践中的实现有多直接,特别是它对计算实现的细节有多敏感。在这里,我们调查这些问题的贝叶斯因素分析在认知科学。我们解释了统计基础贝叶斯因素作为贝叶斯推断的工具,并讨论了效用函数是必要的原则性决定的假设。接下来,我们研究贝叶斯因子在不同条件下如何表现不佳。这包括对贝叶斯因子估计误差的研究。重要的是,它是未知的贝叶斯因子估计的基础上桥抽样是无偏的复杂的分析。我们是第一个使用基于模拟的校准作为工具来测试贝叶斯因子估计的准确性。此外,我们研究了贝叶斯因子对不同MCMC绘制的稳定性。此外,我们研究贝叶斯因子如何依赖于数据的变化。我们还研究了基于贝叶斯因子的决策的可变性,以及如何使用效用函数优化决策。我们概述了一个贝叶斯因子工作流程,研究人员可以使用它来研究贝叶斯因子是否对他们的个体分析具有鲁棒性,我们使用认知科学的一个例子来说明这个工作流程。我们希望这项研究将提供一个工作流程,以测试贝叶斯因素的优势和局限性,作为量化支持科学假设的证据的一种方式。可复制代码可从https://osf.io/y354c/获得。

英文摘要:

Inferences about hypotheses are ubiquitous in the cognitive sciences. Bayes factors provide one general way to compare different hypotheses by their compatibility with the observed data. Those quantifications can then also be used to choose between hypotheses. While Bayes factors provide an immediate approach to hypothesis testing, they are highly sensitive to details of the data/model assumptions. Moreover it's not clear how straightforwardly this approach can be implemented in practice, and in particular how sensitive it is to the details of the computational implementation. Here, we investigate these questions for Bayes factor analyses in the cognitive sciences. We explain the statistics underlying Bayes factors as a tool for Bayesian inferences and discuss that utility functions are needed for principled decisions on hypotheses. Next, we study how Bayes factors misbehave under different conditions. This includes a study of errors in the estimation of Bayes factors. Importantly, it is unknown whether Bayes factor estimates based on bridge sampling are unbiased for complex analyses. We are the first to use simulation-based calibration as a tool to test the accuracy of Bayes factor estimates. Moreover, we study how stable Bayes factors are against different MCMC draws. We moreover study how Bayes factors depend on variation in the data. We also look at variability of decisions based on Bayes factors and how to optimize decisions using a utility function. We outline a Bayes factor workflow that researchers can use to study whether Bayes factors are robust for their individual analysis, and we illustrate this workflow using an example from the cognitive sciences. We hope that this study will provide a workflow to test the strengths and limitations of Bayes factors as a way to quantify evidence in support of scientific hypotheses. Reproducible code is available from https://osf.io/y354c/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑