arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.07180stat.CO
收藏

复杂问题独立扰动费舍尔信息矩阵的改进蒙特卡罗估计

Enhanced Monte Carlo Estimation of the Fisher Information Matrix with Independent Perturbations for Complex Problems

Xuan Wu

摘要:

费舍尔信息矩阵提供了一种基于感兴趣的参数来测量给定观测数据的信息量的方法。在统计建模、系统辨识和参数估计中存在着许多应用。我们有时使用基于蒙特卡罗的方法来估计,因为它的解析形式往往是不可能的或难以计算在现实世界的模型。本文回顾了基于同时扰动的基本方法,提出了一种基于重采样的独立同时扰动的费舍尔信息矩阵估计方法。我们进行理论和数值分析,以显示其准确性,通过方差减少从$O(1/N)$ $O(1/(nN))$,其中$n$是数据的样本量和$N$是一个衡量的蒙特卡罗平均。我们还考虑了准确性和计算成本之间的权衡。

英文摘要:

The Fisher information matrix provides a way to measure the amount of information given observed data based on parameters of interest. Many applications of the FIM exist in statistical modeling, system identification, and parameter estimation. We sometimes use the Monte Carlo-based method to estimate the FIM because its analytical form is often impossible or difficult to be computed in real-world models. In this paper, we review the basic method based on simultaneous perturbations and present an enhanced resampling-based method with independent simultaneous perturbations to estimate the Fisher information matrix. We conduct theoretical and numerical analysis to show its accuracy via variance reduction from $O(1/N)$ to $O(1/(nN))$, where $n$ is the sample size of the data and $N$ is a measure of the Monte Carlo averaging. We also consider the trade-off between accuracy and computational cost.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑