arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.15078stat.MEstat.AP
收藏

实际数据科学模型中干扰参数不确定性对统计推断的影响

The Influence of Nuisance Parameter Uncertainty on Statistical Inference in Practical Data Science Models

Yunrong Wan

AI总结:

本文针对实际数据科学模型中干扰参数不确定性影响统计推断的问题,提出调整置信区域的方法,并在GARCH和神经网络模型上验证其有效性,以更真实反映整体不确定性。

摘要:

出于多种原因——例如避免从单一数据集过拟合,或因为从其他来源获得了模型中某些参数的数值估计——有时将模型的参数分为一组主要参数和一组干扰参数是有用的。然而,干扰参数值的不确定性是影响模型可靠性的不可避免因素。本文研究了在存在干扰参数的情况下,主要感兴趣参数的不确定性计算问题。我们在两种不同的模型形式上展示了一个通用程序:1)具有单变量干扰参数的GARCH时间序列模型,和2)具有多变量干扰参数的多隐藏层前馈神经网络模型。利用现有的干扰参数不确定性理论框架,我们展示了如何在考虑干扰参数引入的固有不确定性的同时,修改主要参数的置信区域。此外,我们的研究验证了适当考虑干扰参数不确定性的调整后置信区域的实际有效性。这种调整有助于数据科学家产生更真实反映整体不确定性的结果。

英文摘要:

For multiple reasons -- such as avoiding overtraining from one data set or because of having received numerical estimates for some parameters in a model from an alternative source -- it is sometimes useful to divide a model's parameters into one group of primary parameters and one group of nuisance parameters. However, uncertainty in the values of nuisance parameters is an inevitable factor that impacts the model's reliability. This paper examines the issue of uncertainty calculation for primary parameters of interest in the presence of nuisance parameters. We illustrate a general procedure on two distinct model forms: 1) the GARCH time series model with univariate nuisance parameter and 2) multiple hidden layer feed-forward neural network models with multivariate nuisance parameters. Leveraging an existing theoretical framework for nuisance parameter uncertainty, we show how to modify the confidence regions for the primary parameters while considering the inherent uncertainty introduced by nuisance parameters. Furthermore, our study validates the practical effectiveness of adjusted confidence regions that properly account for uncertainty in nuisance parameters. Such an adjustment helps data scientists produce results that more honestly reflect the overall uncertainty.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑