COS-Mix:用于改进信息检索的余弦相似度与距离融合
COS-Mix: Cosine Similarity and Distance Fusion for Improved Information Retrieval
AI总结:
本研究提出一种用于RAG的混合检索策略,通过融合余弦相似度与余弦距离度量,结合BM25与向量检索技术,有效提升了稀疏数据下的检索准确性与语义理解能力。
摘要:
本研究提出了一种用于检索增强生成(RAG)的新型混合检索策略,该策略融合了余弦相似度和余弦距离度量以提高检索性能,特别是在稀疏数据上。传统的余弦相似度度量被广泛用于捕捉高维空间中向量之间的相似性。然而,有研究表明该度量在某些场景下会产生任意的结果。为了解决这一局限性,我们引入了余弦距离度量,通过量化向量之间的不相似性来提供互补的视角。与近期使用开源数据集的发表文献不同,我们的方法在专有数据上进行了实验。所提出的方法展现出增强的检索性能,并对文档或项目之间的语义关系提供了更全面的理解。这种混合策略利用诸如 BM25(稀疏)检索、向量(稠密)检索以及基于余弦距离的检索等技术,为在知识密集型应用中高效且准确地检索相关信息提供了一种有前景的解决方案。
英文摘要:
This study proposes a novel hybrid retrieval strategy for Retrieval-Augmented Generation (RAG) that integrates cosine similarity and cosine distance measures to improve retrieval performance, particularly for sparse data. The traditional cosine similarity measure is widely used to capture the similarity between vectors in high-dimensional spaces. However, it has been shown that this measure can yield arbitrary results in certain scenarios. To address this limitation, we incorporate cosine distance measures to provide a complementary perspective by quantifying the dissimilarity between vectors. Our approach is experimented on proprietary data, unlike recent publications that have used open-source datasets. The proposed method demonstrates enhanced retrieval performance and provides a more comprehensive understanding of the semantic relationships between documents or items. This hybrid strategy offers a promising solution for efficiently and accurately retrieving relevant information in knowledge-intensive applications, leveraging techniques such as BM25 (sparse) retrieval , vector (Dense) retrieval, and cosine distance based retrieval to facilitate efficient information retrieval.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。