arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.09855cs.DScs.DBcs.IR
收藏

高维近似最近邻搜索:可靠有效的距离比较操作

High-Dimensional Approximate Nearest Neighbor Search: with Reliable and Efficient Distance Comparison Operations

Jianyang Gao, Cheng Long

摘要:

近似K近邻搜索(AKNN)是一个基本而又具有挑战性的问题.我们观察到,在高维空间中,几乎所有的AKNN算法的时间消耗都是由距离比较操作(DCO)所支配的。对于每个操作,它扫描对象的全部维度,因此在线性时间内运行。为了加快速度,我们提出了一个随机算法,命名为ADSampling,运行在对数时间wrt的维数为大多数DCO和成功的概率很高。此外,基于ADSampling,我们开发了一个通用的和两个算法特定的技术作为插件,以增强现有的AKNN算法。理论和实证研究都证实:(1)我们的技术几乎没有引入准确性损失,(2)它们始终提高效率。

英文摘要:

Approximate K nearest neighbor (AKNN) search is a fundamental and challenging problem. We observe that in high-dimensional space, the time consumption of nearly all AKNN algorithms is dominated by that of the distance comparison operations (DCOs). For each operation, it scans full dimensions of an object and thus, runs in linear time wrt the dimensionality. To speed it up, we propose a randomized algorithm named ADSampling which runs in logarithmic time wrt to the dimensionality for the majority of DCOs and succeeds with high probability. In addition, based on ADSampling we develop one general and two algorithm-specific techniques as plugins to enhance existing AKNN algorithms. Both theoretical and empirical studies confirm that: (1) our techniques introduce nearly no accuracy loss and (2) they consistently improve the efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑