arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.11547cs.DScs.IRcs.LG
收藏

DartMinHash:加权集的快速绘制

DartMinHash: Fast Sketching for Weighted Sets

Norwegian University of Science and Technology(挪威科技大学)

Tobias Christiani

摘要:

加权最小哈希是一种标准的降维技术,可应用于相似性搜索和大规模核机器。我们介绍了一个简单的算法,采用加权集$x \in \mathbb{R}_{\geq 0}^{d}$并在预期时间$O(k \log k + \Vert x \Vert_{0}\log( \Vert x \Vert_1 + 1/\Vert x \Vert_1))$内计算$k$独立minhash,改进了最先进的BagMinHash算法(KDD '18),并代表了稀疏数据的最快加权minhash算法。我们的实验表明,与ICWS(ICDM '10)和BagMinhash相比,$k$和$\Vert x \Vert_0$的运行时间扩展更好,在常见用例中获得$10$ x加速。我们的方法还产生了一种技术,用于计算完全独立的局部敏感的哈希值$(L, K)$ -参数化的近似近邻搜索加权Jaccard相似性下的最佳预期时间$O(LK + \Vert x \Vert_0)$,改善以前的工作,即使在未加权集的情况下。

英文摘要:

Weighted minwise hashing is a standard dimensionality reduction technique with applications to similarity search and large-scale kernel machines. We introduce a simple algorithm that takes a weighted set $x \in \mathbb{R}_{\geq 0}^{d}$ and computes $k$ independent minhashes in expected time $O(k \log k + \Vert x \Vert_{0}\log( \Vert x \Vert_1 + 1/\Vert x \Vert_1))$, improving upon the state-of-the-art BagMinHash algorithm (KDD '18) and representing the fastest weighted minhash algorithm for sparse data. Our experiments show running times that scale better with $k$ and $\Vert x \Vert_0$ compared to ICWS (ICDM '10) and BagMinhash, obtaining $10$x speedups in common use cases. Our approach also gives rise to a technique for computing fully independent locality-sensitive hash values for $(L, K)$-parameterized approximate near neighbor search under weighted Jaccard similarity in optimal expected time $O(LK + \Vert x \Vert_0)$, improving on prior work even in the case of unweighted sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑