验证未观测数据的预测
Validating Predictions of Unobserved Quantities
摘要:
大多数计算模型的最终目的是进行预测,通常支持某些决策过程(例如,用于某些系统的设计或操作)。需要预测的量(感兴趣的量或QoI)在预测之前通常不是实验上可观察的,因为否则将不需要预测。评估这种推断性预测的有效性是一项挑战,而这对知情决策至关重要。在经典的验证方法中,将观测量的模型输出与观测值进行比较,以确定它们是否一致。就其本身而言,这种一致性仅确保模型可以预测观测条件下的观测量。这种限制大大降低了决策验证工作的效用,因为它不意味着对未观察到的QoI或观察范围之外的场景的预测。然而,目前科学界对于验证使用计算模型进行的外推预测的最佳做法没有达成一致意见。本文的目的是提出和探索一个验证和预测评估过程,支持外推预测模型与已知的误差来源。该过程包括随机建模、校准、验证和预测评估阶段,其中构建、告知和测试已知不确定性和误差来源的表示。所提出的方法适用于一个说明性的外推问题,涉及一个错误指定的非线性振子。
英文摘要:
The ultimate purpose of most computational models is to make predictions, commonly in support of some decision-making process (e.g., for design or operation of some system). The quantities that need to be predicted (the quantities of interest or QoIs) are generally not experimentally observable before the prediction, since otherwise no prediction would be needed. Assessing the validity of such extrapolative predictions, which is critical to informed decision-making, is challenging. In classical approaches to validation, model outputs for observed quantities are compared to observations to determine if they are consistent. By itself, this consistency only ensures that the model can predict the observed quantities under the conditions of the observations. This limitation dramatically reduces the utility of the validation effort for decision making because it implies nothing about predictions of unobserved QoIs or for scenarios outside of the range of observations. However, there is no agreement in the scientific community today regarding best practices for validation of extrapolative predictions made using computational models. The purpose of this paper is to propose and explore a validation and predictive assessment process that supports extrapolative predictions for models with known sources of error. The process includes stochastic modeling, calibration, validation, and predictive assessment phases where representations of known sources of uncertainty and error are built, informed, and tested. The proposed methodology is applied to an illustrative extrapolation problem involving a misspecified nonlinear oscillator.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。