arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.08686cs.DBcs.CLcs.IR
收藏

基于知识图谱的检索增强生成用于模式匹配

Knowledge Graph-based Retrieval-Augmented Generation for Schema Matching

Aalborg University(奥尔堡大学);Eötvös Loránd University(厄特沃什·罗兰大学)

Chuangtao Ma, Sriom Chakrabarti, Arijit Khan, Bálint Molnár

AI总结:

针对传统模式匹配方法语义理解不足及大模型幻觉问题,提出基于知识图谱的检索增强生成模型KG-RAG4SM,通过多类图检索与排序策略增强LLM,在多个数据集上性能显著优于现有SOTA方法,且能缓解幻觉、适配大型知识图谱。

摘要:

传统的基于相似度的模式匹配方法由于缺乏常识和领域特定知识,无法解决领域特定复杂映射场景中的语义歧义与冲突问题。大语言模型(LLM)的幻觉问题也使得基于LLM的模式匹配难以应对上述问题。为此,我们提出了一种用于模式匹配的基于知识图谱的检索增强生成模型,称为KG-RAG4SM。具体而言,KG-RAG4SM引入了新颖的基于向量、基于图遍历和基于查询的图检索方法,以及混合策略与排序方案,可从外部大型知识图谱(KG)中识别最相关的子图。我们证明,基于KG的检索增强LLM无需任何重新训练,就能为复杂匹配案例生成更准确的结果。实验结果显示,在MIMIC数据集上,KG-RAG4SM在精确率和F1分数上分别比基于LLM的当前最优(SOTA)方法(如Jellyfish-8B)高出35.89%和30.50%;搭载GPT-4o-mini的KG-RAG4SM在Synthea数据集上,精确率和F1分数分别比基于预训练语言模型(PLM)的SOTA方法(如SMAT)高出69.20%和21.97%。结果还表明,我们的方法在端到端模式匹配中效率更高,并且可扩展至从大型KG中进行检索。我们在真实世界模式匹配场景的数据集上开展的案例研究显示,我们的方案很好地缓解了LLM在模式匹配中的幻觉问题。

英文摘要:

Traditional similarity-based schema matching methods fail to resolve semantic ambiguities and conflicts in complex, domain-specific mappings due to a lack of commonsense and domain-specific knowledge. In parallel, large language models (LLMs) without sufficient background knowledge tend to hallucinate, further complicating schema matching. To overcome these limitations, we introduce KG-RAG4SM, a Knowledge Graph-based Retrieval-Augmented Generation for Schema Matching. This method integrates novel retrieval mechanisms, including LLM-based, vector-based, graph traversal-based, and hybrid techniques with advanced reranking schemes to extract the most relevant subgraphs from large external KGs. Our approach achieves superior results without requiring re-training, as evidenced by improvements of 39.79% in precision and 30.56% in F1 score over LLM-based state-of-the-art (SOTA) methods (e.g., Jellyfish-8B) on the MIMIC dataset, and enhancements of 69.20% in precision and 21.99% in F1 score over pre-trained language model (PLM)-based SOTA methods (e.g., SMAT) on the Synthea dataset. Additionally, KG-RAG4SM scales effectively across KGs from commonsense KGs to domain-specific ones, while its instruction-tuning knowledge exclusion component ensures truthful performance in end-to-end schema matching tasks despite the suboptimal relevance of KG context. Our empirical analysis and case studies from real-world scenarios show that the hallucination problem in LLMs for schema matching is well mitigated by our solution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑