arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1608.05522cs.ITmath.IT
收藏

再访Bernoulli和多项分布的计数两部分粗MDL(扩展版)

Revisiting enumerative two-part crude MDL for Bernoulli and multinomial distributions (Extended version)

Marc Boullé, Fabrice Clérot, Carine Hue

摘要:

我们利用最小描述长度(MDL)的原则作为伯努利分布的模型选择技术,并比较几种类型的MDL代码。首先,我们提出了一个简单的原油两部分MDL码和归一化最大似然(NML)码。然后,我们专注于枚举两部分原油MDL代码,提出了贝叶斯解释有限大小的数据样本,并表现出与NML方法的强有力的连接。我们获得了令人惊讶的影响,模型的复杂性估计以及优越的压缩性能。然后将其推广到多项分布的情况。理论分析和实验比较都表明,对于伯努利分布和多项分布,实际上可以使用枚举码而不是NML。

英文摘要:

We leverage the Minimum Description Length (MDL) principle as a model selection technique for Bernoulli distributions and compare several types of MDL codes. We first present a simplistic crude two-part MDL code and a Normalized Maximum Likelihood (NML) code. We then focus on the enumerative two-part crude MDL code, suggest a Bayesian interpretation for finite size data samples, and exhibit a strong connection with the NML approach. We obtain surprising impacts on the estimation of the model complexity together with superior compression performance. This is then generalized to the case of the multinomial distributions. Both the theoretical analysis and the experimental comparisons suggest that one might use the enumerative code rather than NML in practice, for Bernoulli and multinomial distributions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑