arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.05047stat.MEmath.STstat.APstat.MLstat.TH
收藏

基于PPR鞅置信序列的PAC模式估计

PAC Mode Estimation using PPR Martingale Confidence Sequences

Shubham Anand Jain, Rohan Shah, Sanit Gupta, Denil Mehta, Inderjeet Jayakumar Nair, Jian Vora, Sushil Khyalia, Sourav Das, Vinay J. Ribeiro, Shivaram Kalyanakrishnan

摘要:

我们考虑的问题,正确识别的\textit{mode}的离散分布$\mathcal{P}$具有足够高的概率,通过观察一个序列的i.i.d.从$\mathcal{P}$中抽取样本。当$\mathcal{P}$具有大小为$K = 2$的支持集时,该问题简化为单个参数的估计。在注意到这种特殊情况下,解决了很好的先验后验比(PPR)鞅置信序列\citep{waudby-ramdas-ppr},我们提出了一个推广模式估计,其中$\mathcal{P}$可能采取$K \geq 2$值。首先,我们表明,“一对一”的原则,从$K = 2$推广到$K \geq 2$类是更有效的“一对休息”的替代。然后,我们证明了我们得到的停止规则,表示为PPR-1v 1,是渐近最优的(作为错误概率采取$0$)。PPR-1v 1是无参数和计算量轻,即使在非渐近制度中,也比竞争对手产生更少的样本。我们在采样的两个实际应用中展示了它的收益:选举预测和区块链中智能合约的验证。

英文摘要:

We consider the problem of correctly identifying the \textit{mode} of a discrete distribution $\mathcal{P}$ with sufficiently high probability by observing a sequence of i.i.d. samples drawn from $\mathcal{P}$. This problem reduces to the estimation of a single parameter when $\mathcal{P}$ has a support set of size $K = 2$. After noting that this special case is tackled very well by prior-posterior-ratio (PPR) martingale confidence sequences \citep{waudby-ramdas-ppr}, we propose a generalisation to mode estimation, in which $\mathcal{P}$ may take $K \geq 2$ values. To begin, we show that the "one-versus-one" principle to generalise from $K = 2$ to $K \geq 2$ classes is more efficient than the "one-versus-rest" alternative. We then prove that our resulting stopping rule, denoted PPR-1v1, is asymptotically optimal (as the mistake probability is taken to $0$). PPR-1v1 is parameter-free and computationally light, and incurs significantly fewer samples than competitors even in the non-asymptotic regime. We demonstrate its gains in two practical applications of sampling: election forecasting and verification of smart contracts in blockchains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑