arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1606.00787stat.MLcs.AIcs.LGstat.COstat.ME
收藏

推理后优先交换

Post-Inference Prior Swapping

Carnegie Mellon University(卡内基梅隆大学)

Willie Neiswanger, Eric Xing

摘要:

虽然贝叶斯方法因其结合有用的先验知识的能力而受到称赞,但在实践中,通常使用方便的先验,允许计算成本低或易于处理的推理。在本文中,我们研究了以下问题:对于一个给定的模型,是否有可能计算一个推理结果与任何方便的假先验,然后,给定任何目标先验的利益,迅速将此结果转换为目标后验?一种潜在的解决方案是使用重要性抽样(IS)。然而,我们证明,IS将失败的目标先验的许多选择,这取决于它的参数形式和相似性的假先验。相反,我们提出了先验交换,这种方法利用预先推断的假后验有效地生成准确的后验样本下任意目标先验。先验交换允许我们将成本较低的推理算法应用于某些模型,并在“后推理”中包含新的或更新的先验信息。我们给我们的方法的理论保证,并证明它的经验上的一些模型和先验。

英文摘要:

While Bayesian methods are praised for their ability to incorporate useful prior knowledge, in practice, convenient priors that allow for computationally cheap or tractable inference are commonly used. In this paper, we investigate the following question: for a given model, is it possible to compute an inference result with any convenient false prior, and afterwards, given any target prior of interest, quickly transform this result into the target posterior? A potential solution is to use importance sampling (IS). However, we demonstrate that IS will fail for many choices of the target prior, depending on its parametric form and similarity to the false prior. Instead, we propose prior swapping, a method that leverages the pre-inferred false posterior to efficiently generate accurate posterior samples under arbitrary target priors. Prior swapping lets us apply less-costly inference algorithms to certain models, and incorporate new or updated prior information "post-inference". We give theoretical guarantees about our method, and demonstrate it empirically on a number of models and priors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑