$s$-值:评估关于分布偏移的稳定性
The $s$-value: evaluating stability with respect to distributional shifts
AI总结:
本文提出 $s$-值,用 Kullback-Leibler 散度球及方向性、变量特定偏移刻画统计参数的分布不稳定性,并在真实数据上验证其可指导数据收集、提升偏移分布下的估计精度。
摘要:
常见的统计不确定性度量(如 $p$-值和置信区间)量化的是由抽样引起的不确定性,即因未观测到完整总体而产生的不确定性。然而,抽样并不是不确定性的唯一来源。在实践中,分布会随地点和时间发生变化。这使得收集可在不同数据集之间迁移的知识变得困难。我们提出了一种不稳定性度量,用于量化统计参数关于 Kullback-Leibler 散度的分布不稳定性,即该参数在 Kullback-Leibler 散度球内一般分布扰动下的敏感性。此外,我们还量化了参数关于方向性或变量特定偏移的不稳定性。度量关于方向性偏移的不稳定性可用于检测参数敏感的偏移类型。我们讨论了此类知识如何为数据收集提供信息,以改进偏移分布下统计参数的估计。我们在真实数据上评估了所提出度量的性能,并表明它能够阐明参数关于某些偏移的分布不稳定性,并且可用于提高偏移分布下的估计精度。
英文摘要:
Common statistical measures of uncertainty such as $p$-values and confidence intervals quantify the uncertainty due to sampling, that is, the uncertainty due to not observing the full population. However, sampling is not the only source of uncertainty. In practice, distributions change between locations and across time. This makes it difficult to gather knowledge that transfers across data sets. We propose a measure of instability that quantifies the distributional instability of a statistical parameter with respect to Kullback-Leibler divergence, that is, the sensitivity of the parameter under general distributional perturbations within a Kullback-Leibler divergence ball. In addition, we quantify the instability of parameters with respect to directional or variable-specific shifts. Measuring instability with respect to directional shifts can be used to detect the type of shifts a parameter is sensitive to. We discuss how such knowledge can inform data collection for improved estimation of statistical parameters under shifted distributions. We evaluate the performance of the proposed measure on real data and show that it can elucidate the distributional instability of a parameter with respect to certain shifts and can be used to improve estimation accuracy under shifted distributions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。