arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.13612stat.MEmath.PRmath.STstat.COstat.MLstat.TH
收藏

基于蒙特卡洛方法的稳健输出分析

Robust Output Analysis with Monte-Carlo Methodology

Kimia Vahdat, Sara Shashaani

AI总结:

本文提出了一种基于蒙特卡洛抽样的统一输出分析框架,通过非参数量化方差与偏差并结合偏差校正估计与方差缩减技术,为仿真与机器学习输出构建了具有更高覆盖概率的稳健置信区间。

摘要:

在仿真或机器学习的预测建模中,通过输出分析准确评估估计值的质量至关重要。近几十年来,输出分析因引入了量化输入数据不确定性对模型输出影响的方法而变得丰富,从而提高了稳健性。然而,大多数进展都假设输入数据服从某一参数分布族。我们通过蒙特卡洛抽样的视角,为仿真和机器学习输出提出了一种统一的输出分析框架。该框架提供了对输出中引起的方差和偏差的非参数量化,并具有高阶精度。我们从模型输出中得出的新的偏差校正估计,利用了快速迭代自助抽样扩展和高阶影响函数。为了使所提出的估计方法具有可扩展性,我们设计了预算最优规则,并利用控制变量来降低方差。我们的理论和数值结果表明,在从模型输出构建具有更高覆盖概率的更稳健的置信区间方面具有明显优势。

英文摘要:

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the impact of input data uncertainty in the model outputs to increase robustness. However, most developments are applicable assuming that the input data adheres to a parametric family of distributions. We propose a unified output analysis framework for simulation and machine learning outputs through the lens of Monte Carlo sampling. This framework provides nonparametric quantification of the variance and bias induced in the outputs with higher-order accuracy. Our new bias-corrected estimation from the model outputs leverages the extension of fast iterative bootstrap sampling and higher-order influence functions. For the scalability of the proposed estimation methods, we devise budget-optimal rules and leverage control variates for variance reduction. Our theoretical and numerical results demonstrate a clear advantage in building more robust confidence intervals from the model outputs with higher coverage probability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑