arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.03052math.STcs.LGstat.TH
收藏

未观察事件的置信区间

Confidence Intervals for Unobserved Events

Tel Aviv University(特拉维夫大学)

Amichai Painsky

摘要:

考虑可数字母表上未知分布的有限样本。未观察到的事件是样本中未出现的字母符号。估计未观测事件的概率是统计学及相关领域中的一个基本问题,在点估计的背景下得到了广泛的研究。在这项工作中,我们介绍了一种新的区间估计计划未观察到的事件。我们提出的框架适用于选择性推理,因为我们构造置信区间(CI)所需的参数集。有趣的是,我们表明,获得的CI是无量纲的,因为它们不随字母表的大小而增长。此外,我们表明,这些CI是(几乎)紧,在这个意义上说,他们不能进一步改善,而不违反规定的覆盖率。我们证明了我们所提出的方案在合成和现实世界的实验中的性能,表现出显着的改进的替代品。最后,我们将我们提出的计划,大字母表建模。我们介绍了一种新的同时CI计划的大字母表分布优于目前已知的方法,同时保持规定的覆盖率。

英文摘要:

Consider a finite sample from an unknown distribution over a countable alphabet. Unobserved events are alphabet symbols which do not appear in the sample. Estimating the probabilities of unobserved events is a basic problem in statistics and related fields, which was extensively studied in the context of point estimation. In this work we introduce a novel interval estimation scheme for unobserved events. Our proposed framework applies selective inference, as we construct confidence intervals (CIs) for the desired set of parameters. Interestingly, we show that obtained CIs are dimension-free, as they do not grow with the alphabet size. Further, we show that these CIs are (almost) tight, in the sense that they cannot be further improved without violating the prescribed coverage rate. We demonstrate the performance of our proposed scheme in synthetic and real-world experiments, showing a significant improvement over the alternatives. Finally, we apply our proposed scheme to large alphabet modeling. We introduce a novel simultaneous CI scheme for large alphabet distributions which outperforms currently known methods while maintaining the prescribed coverage rate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑