arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.08933cs.IRcs.AIcs.DB
收藏

RoarGraph:一种用于高效跨模态近似最近邻搜索的投影二分图

RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Search

Fudan University(复旦大学)

Meng Chen, Kai Zhang, Zhenying He, Yinan Jing, X. Sean Wang

AI总结:

针对跨模态ANNS中查询分布外导致现有方法效率低的问题,提出基于查询分布构建的RoarGraph图索引,在跨模态数据集上90%召回率下搜索速度最高达现有方法的3.56倍。

摘要:

近似最近邻搜索(ANNS)是推荐系统、基于大语言模型的应用等诸多场景中的基础核心组件。随着多模态神经模型的发展——这类模型将不同模态的数据转换到共享高维空间中作为特征向量——跨模态ANNS旨在使用某一模态(如文本)的数据向量作为查询,从另一模态(如图像或视频)中检索最相似的条目。然而,不同模态的嵌入之间存在固有分布差距,跨模态查询相对于基底数据成为分布外(OOD)样本,因此现有最先进的ANNS方法在OOD工作负载下表现不佳。本文对OOD工作负载的特性进行了定量分析,以理解其ANNS效率问题。与单模态工作负载不同,我们发现OOD查询在空间上偏离基底数据,且OOD查询的k近邻在嵌入空间中彼此相距较远。这一特性打破了现有ANNS方法的假设,与其高效搜索的设计初衷不匹配。基于对OOD工作负载的洞察,我们提出了投影二分图(pRojected bipartite Graph,RoarGraph),这是一种在查询分布指导下构建的高效ANNS图索引。大量实验表明,RoarGraph在现代跨模态数据集上的表现显著优于现有最先进方法,在OOD查询的90%召回率下,搜索速度最高可达3.56倍。

英文摘要:

Approximate Nearest Neighbor Search (ANNS) is a fundamental and critical component in many applications, including recommendation systems and large language model-based applications. With the advancement of multimodal neural models, which transform data from different modalities into a shared high-dimensional space as feature vectors, cross-modal ANNS aims to use the data vector from one modality (e.g., texts) as the query to retrieve the most similar items from another (e.g., images or videos). However, there is an inherent distribution gap between embeddings from different modalities, and cross-modal queries become Out-of-Distribution (OOD) to the base data. Consequently, state-of-the-art ANNS approaches suffer poor performance for OOD workloads. In this paper, we quantitatively analyze the properties of the OOD workloads to gain an understanding of their ANNS efficiency. Unlike single-modal workloads, we reveal OOD queries spatially deviate from base data, and the k-nearest neighbors of an OOD query are distant from each other in the embedding space. The property breaks the assumptions of existing ANNS approaches and mismatches their design for efficient search. With insights from the OOD workloads, we propose pRojected bipartite Graph (RoarGraph), an efficient ANNS graph index built under the guidance of query distribution. Extensive experiments show that RoarGraph significantly outperforms state-of-the-art approaches on modern cross-modal datasets, achieving up to 3.56x faster search speed at a 90% recall rate for OOD queries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑