arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.21799cs.IR
收藏

KG20C & KG20C-QA:面向链接预测和问答的学术知识图谱基准测试

KG20C & KG20C-QA: Scholarly Knowledge Graph Benchmarks for Link Prediction and Question Answering

University of Information Technology, Vietnam(越南信息技术大学);Vietnam National University, Ho Chi Minh City(越南国立大学胡志明市分校);National Institute of Informatics(日本国立情报学研究所);The Graduate University for Advanced Studies, SOKENDAI(综合研究大学院大学)

Hung-Nghiep Tran, Atsuhiro Takasu

AI总结:

本文提出KG20C和KG20C-QA两个学术知识图谱基准测试,用于提升基于学术数据的问答和推理能力。

摘要:

本文介绍了KG20C和KG20C-QA两个精心编纂的数据集,用于推动基于学术数据的问答(QA)研究。KG20C是一个高质量的学术知识图谱,通过针对选定的会议、基于质量的过滤和模式定义从微软学术图构建而成。尽管KG20C已在非同行评审的来源如GitHub仓库中公开,但本文提供了该数据集的第一个正式、同行评审的描述,包括对其构建和规范的清晰文档。KG20C-QA是在KG20C基础上构建的,以支持在学术数据上的问答任务。我们定义了一组问答模板,将图三元组转换为自然语言问题-答案对,产生一个可用于基于图的模型如知识图谱嵌入和基于文本的模型如大型语言模型的基准测试。我们对标准的知识图谱嵌入方法在KG20C-QA上进行基准测试,分析不同关系类型上的性能,并提供可重复的评估协议。通过正式发布这些数据集并提供详尽的文档,我们旨在为研究社区贡献一个可重用、可扩展的资源,使未来在问答、推理和知识驱动应用中的学术领域研究得以推进。完整的数据集将在论文发表时发布至https://github.com/tranhungnghiep/KG20C/。

英文摘要:

In this paper, we present KG20C and KG20C-QA, two curated datasets for advancing question answering (QA) research on scholarly data. KG20C is a high-quality scholarly knowledge graph constructed from the Microsoft Academic Graph through targeted selection of venues, quality-based filtering, and schema definition. Although KG20C has been available online in non-peer-reviewed sources such as GitHub repository, this paper provides the first formal, peer-reviewed description of the dataset, including clear documentation of its construction and specifications. KG20C-QA is built upon KG20C to support QA tasks on scholarly data. We define a set of QA templates that convert graph triples into natural language question--answer pairs, producing a benchmark that can be used both with graph-based models such as knowledge graph embeddings and with text-based models such as large language models. We benchmark standard knowledge graph embedding methods on KG20C-QA, analyze performance across relation types, and provide reproducible evaluation protocols. By officially releasing these datasets with thorough documentation, we aim to contribute a reusable, extensible resource for the research community, enabling future work in QA, reasoning, and knowledge-driven applications in the scholarly domain. The full datasets will be released at https://github.com/tranhungnghiep/KG20C/ upon paper publication.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑