重复使用、回收利用、重新称重:通过对海量数据进行高效的顺序贝叶斯计算来抗击流感
Reuse, recycle, reweigh: Combating influenza through efficient sequential Bayesian computation for massive data
摘要:
千兆字节和兆兆字节范围内的大量数据集与日益复杂的统计工具相结合,在计算可行的边界上产生分析。面对这种计算负担,通过将数据集划分为更易于处理的大小来进行妥协,导致分层分析,从证明初始数据收集合理的背景中删除。在贝叶斯框架中,这些分层分析生成中间实现,通常使用点估计进行比较,这些点估计无法解释这些实现近似的分布之间的变异性和相关性。然而,虽然最初的让步,分层一般排除了更明智的分析,使用一个单一的联合层次模型,我们可以绕过这一结果,并利用中间实现扩展的动态迭代重新加权MCMC算法。在这样做的时候,我们通过用重要性权重重新加权它们来重用可用的实现,将它们回收到现在易于处理的联合层次模型中。我们将这种技术应用于从跨越13年的687个甲型流感病毒基因组的分层分析产生的中间实现,使我们能够在分层统计框架内重新审视关于流感进化史的假设。
英文摘要:
Massive datasets in the gigabyte and terabyte range combined with the availability of increasingly sophisticated statistical tools yield analyses at the boundary of what is computationally feasible. Compromising in the face of this computational burden by partitioning the dataset into more tractable sizes results in stratified analyses, removed from the context that justified the initial data collection. In a Bayesian framework, these stratified analyses generate intermediate realizations, often compared using point estimates that fail to account for the variability within and correlation between the distributions these realizations approximate. However, although the initial concession to stratify generally precludes the more sensible analysis using a single joint hierarchical model, we can circumvent this outcome and capitalize on the intermediate realizations by extending the dynamic iterative reweighting MCMC algorithm. In doing so, we reuse the available realizations by reweighting them with importance weights, recycling them into a now tractable joint hierarchical model. We apply this technique to intermediate realizations generated from stratified analyses of 687 influenza A genomes spanning 13 years allowing us to revisit hypotheses regarding the evolutionary history of influenza within a hierarchical statistical framework.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。