AutoSchemaKG:通过从万维网规模语料中动态归纳模式实现自主知识图谱构建
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora
AI总结:
本研究提出无需预定义模式的自主知识图谱构建框架AutoSchemaKG,利用大语言模型同步提取三元组与归纳模式,构建十亿级ATLAS知识图谱系列,在多跳问答等任务上表现更优,可补充大语言模型的参数化知识。
摘要:
我们提出AutoSchemaKG,这是一个完全自主的知识图谱构建框架,无需预定义模式。该系统利用大语言模型直接从文本中同时提取知识三元组并归纳全面的模式,对实体和事件同时建模,同时采用概念化方法将实例组织成语义类别。通过处理超过5000万份文档,我们构建了ATLAS(自动三元组链接与模式归纳),这是一个包含9亿多个节点和59亿条边的知识图谱系列。该方法在多跳问答任务上优于现有最优基线,并提升了大语言模型的事实准确性。值得注意的是,我们的模式归纳在零人工干预的情况下与人工构建的模式达到92%的语义一致性,证明了具备动态归纳模式的十亿级知识图谱可有效补充大语言模型的参数化知识。
英文摘要:
We present AutoSchemaKG, a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. Our system leverages large language models to simultaneously extract knowledge triples and induce comprehensive schemas directly from text, modeling both entities and events while employing conceptualization to organize instances into semantic categories. Processing over 50 million documents, we construct ATLAS (Automated Triple Linking And Schema induction), a family of knowledge graphs with 900+ million nodes and 5.9 billion edges. This approach outperforms state-of-the-art baselines on multi-hop QA tasks and enhances LLM factuality. Notably, our schema induction achieves 92\% semantic alignment with human-crafted schemas with zero manual intervention, demonstrating that billion-scale knowledge graphs with dynamically induced schemas can effectively complement parametric knowledge in large language models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。