归一化流在基于代理模型的贝叶斯推断中的实用性研究
Adapting Neural Posterior Estimators for Simulation-Based Inference in Agent-Based Models
AI总结:
本文提出在基于代理模型的贝叶斯推断中使用测试时间训练归一化流的方法,通过对抗分布偏移提升参数推断的实时调整能力。
摘要:
基于代理模型(ABMs)在经济学和社会科学中日益受到关注,因其在描述个体代理的现实和异质决策及交互规则方面具有强大的灵活性。在本工作中,我们首次探讨了在ABMs的参数后验估计中,深度模型如归一化流的测试时间训练(TTT)的实用性。我们提出了几种实用的TTT策略,用于微调归一化流以对抗分布偏移。我们的数值研究证明,TTT方案效果显著,能够实现实时调整基于流的推断以适应ABM参数。
英文摘要:
Agent-based models (ABMs) are widely used in economics and social sciences. They represent heterogeneous personal behaviors and their interactions by using simulations, whereas their likelihoods are often intractable for parameter estimations. Therefore, most traditional statistical inference techniques are hindered. Driven by recent advances in probabilistic machine learning, recent works have applied neural networks to achieve likelihood-free inference in large-scale ABMs. Specifically, Neural Posterior Estimation using normalizing flows provide amortized Bayesian inference from simulations, yet a pre-trained estimator may become inaccurate when the target task changes. In this work, we investigate the practicality of adapting a pre-trained conditional normalizing flow through a unified sequential neural posterior estimation test-time training (SNPE-TTT) framework. The framework includes four adaptation strategies: full-parameter adaptation, low-rank adaptation, and two update spaces identified from target-task gradients. We evaluate all four methods across economic simulation models with both tractable and intractable likelihoods. These benchmarks demonstrate that the sequential neural posterior estimation test-time training framework can adapt pre-trained posterior estimators to related inference tasks using a limited budget of target simulations. Posterior recovery and computational benefits depend on the task and adaptation strategy, with lower target-stage cost in some settings but no consistently superior posterior accuracy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。