arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1706.07290cs.DS
收藏

HyperLogLog草图的基数估计新方法

New Cardinality Estimation Methods for HyperLogLog Sketches

Otmar Ertl

摘要:

这项工作提出了新的基数估计方法的HyperLogLog草图记录的数据集。发现了原始估计量的一个简单推导,这也提供了如何纠正其缺陷的见解。其结果是一个改进的估计,是无偏的整个基数范围内,是容易计算的,并不依赖于经验确定的数据作为以前的方法。基于最大似然原理,提出了一种二次无偏估计方法,该方法也可以推广到估计两个集合的并、交或相对补的基数,这些集合都表示为HyperLogLog草图。实验结果表明,该方法比传统的基于容斥原理的方法具有更高的精度。

英文摘要:

This work presents new cardinality estimation methods for data sets recorded by HyperLogLog sketches. A simple derivation of the original estimator was found, that also gives insight how to correct its deficiencies. The result is an improved estimator that is unbiased over the full cardinality range, is easy computable, and does not rely on empirically determined data as previous approaches. Based on the maximum likelihood principle a second unbiased estimation method is presented which can also be extended to estimate cardinalities of union, intersection, or relative complements of two sets that are both represented as HyperLogLog sketches. Experimental results show that this approach is more precise than the conventional technique using the inclusion-exclusion principle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑