STABLE:通过幅度均匀性和基数鲁棒性实现高效的混合最近邻搜索
STABLE: Efficient Hybrid Nearest Neighbor Search via Magnitude-Uniformity and Cardinality-Robustness
AI总结:
STABLE通过引入AUTO度量和HELP索引,解决相似性幅度异质性和属性基数鲁棒性问题,实现高效混合最近邻搜索。
摘要:
混合近似最近邻搜索(Hybrid ANNS)是处理大规模异构数据的基础技术,但现有方法忽视了数据分布的异质性,导致相似性幅度异质性和属性基数鲁棒性问题。为了解决这些问题,我们提出了STABLE框架,通过增强的异质语义感知(AUTO)度量和动态异质性路由方法,实现准确、高效和鲁棒的混合ANNS。
英文摘要:
Hybrid Approximate Nearest Neighbor Search (Hybrid ANNS) is a foundational search technology for large-scale heterogeneous data and has gained significant attention in both academia and industry. However, current approaches overlook the heterogeneity in data distribution, thus ignoring two major challenges: the Compatibility Barrier for Similarity Magnitude Heterogeneity and the Tolerance Bottleneck to Attribute Cardinality. To overcome these issues, we propose the robuSt heTerogeneity-Aware hyBrid retrievaL framEwork, STABLE, designed for accurate, efficient, and robust hybrid ANNS under datasets with various distributions. Specifically, we introduce an enhAnced heterogeneoUs semanTic perceptiOn (AUTO) metric to achieve a joint measurement of feature similarity and attribute consistency, addressing similarity magnitude heterogeneity and improving robustness to datasets with various attribute cardinalities. Thereafter, we construct our Heterogeneous sEmantic reLation graPh (HELP) index based on AUTO to organize heterogeneous semantic relations. Finally, we employ a novel Dynamic Heterogeneity Routing method to ensure an efficient search. Extensive experiments on five feature vector benchmarks with various attribute cardinalities demonstrate the superior performance of STABLE.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。