arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.07584cs.IR
收藏

通过知识图谱与GDELT对话

Talking to GDELT Through Knowledge Graphs

Audun Myers, Max Vargas, Sinan G. Aksoy, Cliff Joslyn, Benjamin Wilson, Lee Burke, Tom Grimes

AI总结:

本研究比较了多种RAG方法在GDELT问答任务中的表现,提出基于本体的KG构建框架,并发现本体与LLM协同构建KG更具优势。

摘要:

在这项工作中,我们研究了多种检索增强再生成(RAG)方法,以理解每种方法在问答分析中的优缺点。为了获得这种理解,我们使用了全球事件、语言和语调数据库(GDELT)数据集的案例研究子集,以及从在线新闻文章中抓取的原始文本语料库。为了从文本语料库中检索信息,我们实现了传统的向量存储RAG,以及基于最新大型语言模型(LLM)的自动构建知识图谱(KG)和检索相关子图的方法。除了这些语料库方法外,我们开发了一种新颖的基于本体的框架,直接从GDELT构建知识图谱,该框架利用GDELT的底层模式来创建全球事件的结构化表示。为了从基于本体的知识图谱中检索相关信息,我们实现了直接图查询和最新的图检索方法。我们在问答任务中比较了每种方法的性能。我们发现,虽然我们基于本体的知识图谱对问答有价值,但自动提取相关子图具有挑战性。相反,LLM生成的知识图谱虽然能捕捉事件摘要,但往往缺乏一致性和可解释性。我们的研究结果表明,本体和基于LLM的知识图谱构建之间采用协同方法是有益的,并提出了实现这一目标的拟议途径。

英文摘要:

In this work we study various Retrieval Augmented Regeneration (RAG) approaches to gain an understanding of the strengths and weaknesses of each approach in a question-answering analysis. To gain this understanding we use a case-study subset of the Global Database of Events, Language, and Tone (GDELT) dataset as well as a corpus of raw text scraped from the online news articles. To retrieve information from the text corpus we implement a traditional vector store RAG as well as state-of-the-art large language model (LLM) based approaches for automatically constructing KGs and retrieving the relevant subgraphs. In addition to these corpus approaches, we develop a novel ontology-based framework for constructing knowledge graphs (KGs) from GDELT directly which leverages the underlying schema of GDELT to create structured representations of global events. For retrieving relevant information from the ontology-based KGs we implement both direct graph queries and state-of-the-art graph retrieval approaches. We compare the performance of each method in a question-answering task. We find that while our ontology-based KGs are valuable for question-answering, automated extraction of the relevant subgraphs is challenging. Conversely, LLM-generated KGs, while capturing event summaries, often lack consistency and interpretability. Our findings suggest benefits of a synergistic approach between ontology and LLM-based KG construction, with proposed avenues toward that end.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑