神经网络的无模型局部重校准
Model-Free Local Recalibration of Neural Networks
AI总结:
针对人工神经网络预测不确定性量化难、现有校准方法存在局限的问题,提出基于隐藏层降维表征的局部重校准方法,经模拟和真实数据集验证有效提升了预测与不确定性量化效果。
摘要:
人工神经网络(ANNs)是极具灵活性的预测模型,但可靠量化其预测的不确定性仍是一项持续存在的挑战。近期已有大量针对ANN预测分布“重校准”的研究,旨在让目标事件的预测概率与其对应的频率评估结果保持一致。未校准的概率预测在诸多重要决策任务中应用价值有限。为解决这一问题,我们提出一种ANN预测分布的局部重校准方法,该方法利用ANN隐藏层提供的输入降维表征实现。我们的新方法借鉴了近似贝叶斯计算与无似然推断方法领域文献中的重校准技术。现有大多数ANN校准方法要么在输入层进行校准——当输入为高维时难度较大,要么在输出层进行校准——灵活性可能不足。通过模拟研究,我们证明相较于其他替代方法,本方法具备良好性能,同时探究了基于网络不同层进行局部校准所能带来的增益。最后,我们将所提方法应用于钻石价格预测问题,证明了该方法在实际应用中提升预测效果与不确定性量化水平的潜力。
英文摘要:
Artificial neural networks (ANNs) are highly flexible predictive models. However, reliably quantifying uncertainty for their predictions is a continuing challenge. There has been much recent work on "recalibration" of predictive distributions for ANNs, so that forecast probabilities for events of interest are consistent with certain frequency evaluations of them. Uncalibrated probabilistic forecasts are of limited use for many important decision-making tasks. To address this issue, we propose a localized recalibration of ANN predictive distributions using the dimension-reduced representation of the input provided by the ANN hidden layers. Our novel method draws inspiration from recalibration techniques used in the literature on approximate Bayesian computation and likelihood-free inference methods. Most existing calibration methods for ANNs can be thought of as calibrating either on the input layer, which is difficult when the input is high-dimensional, or the output layer, which may not be sufficiently flexible. Through a simulation study, we demonstrate that our method has good performance compared to alternative approaches, and explore the benefits that can be achieved by localizing the calibration based on different layers of the network. Finally, we apply our proposed method to a diamond price prediction problem, demonstrating the potential of our approach to improve prediction and uncertainty quantification in real-world applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。