用于模型评估的基于百分位数的残差
Percentile-Based Residuals for Model Assessment
摘要:
弹性是诊断模型拟合的关键组成部分。通常的做法是使用观测数据的期望值和标准差计算标准化残差,然后使用这些值检测离群值并评估模型拟合。这些残差的近似正态性是该过程具有良好属性的关键,但在许多建模环境中,特别是对于复杂的多水平模型,正态性可能不成立。在这些情况下,异常值检测和模型诊断没有正确校准。或者,正如我们所证明的,从数据值在其完整预测分布中的百分位位置计算的残差会导致模型拟合的校准评估。我们推广了Dunn和Smyth(1996)描述的方法,并通过案例研究和模拟对性能进行数学评估。此外,我们表明,标准残差可以被校准,以模仿百分位数的方法,但这一额外的步骤是避免直接使用基于序列的残差。对于基于拟合的残差和校准的标准残差,使用具有适当位置、分布和形状的完整预测分布对于有效评估是必要的。
英文摘要:
Residuals are a key component of diagnosing model fit. The usual practice is to compute standardized residuals using expected values and standard deviations of the observed data, then use these values to detect outliers and assess model fit. Approximate normality of these residuals is key for this process to have good properties, but in many modeling contexts, especially for complex, multi-level models, normality may not hold. In these cases outlier detection and model diagnostics aren't properly calibrated. Alternatively, as we demonstrate, residuals computed from the percentile location of a datum's value in its full predictive distribution lead to well calibrated evaluations of model fit. We generalize an approach described by Dunn and Smyth (1996) and evaluate properties mathematically, via case-studies and by simulation. In addition, we show that the standard residuals can be calibrated to mimic the percentile approach, but that this extra step is avoided by directly using percentile-based residuals. For both the percentile-based residuals and the calibrated standard residuals, the use of full predictive distributions with the appropriate location, spread and shape is necessary for valid assessments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。