如何从模拟中估计 Fisher 信息矩阵
How to estimate Fisher information matrices from simulations
AI总结:
本文提出一种与标准 Monte Carlo Fisher 估计量偏差方向相反的新估计量,并将二者组合形成近似无偏估计,从而以更少模拟样本加快 Fisher 预测收敛。
摘要:
Fisher 信息矩阵是信息几何和渐近统计中具有根本重要性的量。在实践中,它被广泛用于快速估计数据集中可用的预期信息,并指导实验设计选择。在许多现代应用中,解析计算 Fisher 信息难以处理,因此改用 Monte Carlo 方法。当 Monte Carlo 噪声不可忽略时,标准 Monte Carlo 方法给出的 Fisher 信息估计可能存在偏差。最成问题的是导数中的噪声,因为这会导致高估由 Fisher 信息的逆给出的可用约束能力。在这项工作中,我们找到了另一种简单的估计量,它具有相反方向的偏差,并会低估约束能力。该估计量既可以用于给出参数约束的近似界限,也可以与标准估计量结合,以得到改进的、近似无偏的估计。替代估计量和组合估计量都是渐近无偏的,因此也可以用作标准方法的收敛性检验。我们讨论了这些估计量的潜在局限,并提供评估其可靠性的方法。这些方法加快了 Fisher 预测的收敛,因为只需更少的 Monte Carlo 样本即可获得无偏估计,因此可用于将模拟数据集的规模降低数个数量级。
英文摘要:
The Fisher information matrix is a quantity of fundamental importance for information geometry and asymptotic statistics. In practice, it is widely used to quickly estimate the expected information available in a data set and guide experimental design choices. In many modern applications, it is intractable to analytically compute the Fisher information and Monte Carlo methods are used instead. The standard Monte Carlo method produces estimates of the Fisher information that can be biased when the Monte-Carlo noise is non-negligible. Most problematic is noise in the derivatives as this leads to an overestimation of the available constraining power, given by the inverse Fisher information. In this work we find another simple estimate that is oppositely biased and produces an underestimate of the constraining power. This estimator can either be used to give approximate bounds on the parameter constraints or can be combined with the standard estimator to give improved, approximately unbiased estimates. Both the alternative and the combined estimators are asymptotically unbiased so can be also used as a convergence check of the standard approach. We discuss potential limitations of these estimators and provide methods to assess their reliability. These methods accelerate the convergence of Fisher forecasts, as unbiased estimates can be achieved with fewer Monte Carlo samples, and so can be used to reduce the simulated data set size by several orders of magnitude.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。