arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.03225cs.DBcs.DS
收藏

HRNN: 一种用于高维向量近似反向k近邻搜索的混合图索引

HRNN: A Hybrid Graph Index for Approximate Reverse k-Nearest Neighbor Search on High-Dimensional Vectors

HKUST (GZ)(香港科技大学(广州));HKUST(香港科技大学);University of Leicester(莱斯特大学)

Wenxuan Xia, Mingyu Yang, Wentao Li, Wei Wang

AI总结:

针对高维空间中反向k近邻搜索存在的候选扩展开销大和验证成本高的问题,提出HRNN混合图索引,通过代理点策略和离线物化kNN半径实现高效近似搜索。

摘要:

反向k近邻(RkNN)搜索返回所有将查询向量视为其k近邻(kNN)之一的数据点。现有的RkNN方法通常遵循过滤-验证框架:首先收集查询向量附近的向量作为候选,然后根据它们的kNN半径(即到第k近邻的距离)进行验证。然而,现有方法在高维空间中面临两个关键限制。首先,附近的向量通常不属于查询的真实RkNN集,导致过度的候选扩展开销。其次,现有方法在验证过程中在线计算kNN半径,产生大量查询处理成本。为解决这些限制,我们提出了HRNN,一种用于近似RkNN搜索的混合图索引。(1)HRNN不直接将附近向量视为RkNN候选,而是基于查询的RkNN结果通常可以通过其附近向量的RkNN结果发现的假设,将它们用作代理点。(2)为降低验证成本,HRNN离线物化高保真度的kNN半径,消除了昂贵的在线重建,同时保持准确性。HRNN将导航图、排序KNN图和反向邻居列表组合成一个混合索引,支持高效的代理检索、候选生成和kNN半径访问。我们还开发了高效的索引构建和仅追加维护算法。大量实验表明,HRNN始终优于现有方法,吞吐量提升高达一个数量级。此外,HRNN可扩展到包含多达1000万个高维向量的数据集,同时支持高效的动态索引维护。

英文摘要:

Reverse k-nearest neighbor (RkNN) search returns all data points that regard a query vector as one of their k-nearest neighbors (kNNs). Existing RkNN methods typically follow a filter-and-verification framework: vectors near the query vector are first collected as candidates and then verified against their kNN-radius (i.e., the distance to their k-th nearest neighbor). However, existing methods face two key limitations in high-dimensional spaces. First, nearby vectors often do not belong to the query's true RkNN set, resulting in excessive candidate expansion overhead. Second, existing methods compute kNN-radius online during verification, incurring substantial query-processing cost. To address these limitations, we propose HRNN, a hybrid graph index for approximate RkNN search. (1) Rather than directly treating nearby vectors as RkNN candidates, HRNN uses them as proxy points based on the assumption that a query's RkNN results can often be discovered through the RkNN results of its nearby vectors. (2) To reduce verification cost, HRNN materializes high-fidelity kNN-radius offline, eliminating expensive online reconstruction while preserving accuracy. HRNN combines a navigation graph, a ranked KNN graph, and reverse-neighbor lists into a hybrid index that supports efficient proxy retrieval, candidate generation, and kNN-radius access. We also develop efficient index construction and append-only maintenance algorithms. Extensive experiments show that HRNN consistently outperforms existing methods, achieving up to one order of magnitude higher throughput. Moreover, HRNN scales to datasets containing up to 10 million high-dimensional vectors while supporting efficient dynamic index maintenance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑