arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.08804cs.CL
收藏

探索基础模型从文本生成知识图谱的上下文学习能力

Exploring In-Context Learning Capabilities of Foundation Models for Generating Knowledge Graphs from Text

Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(卢蒙巴大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学);University of Lübeck(吕贝克大学);IBM Research(IBM研究院)

Hanieh Khorashadizadeh, Nandana Mihindukulasooriya, Sanju Tiwari, Jinghua Groppe, Sven Groppe

AI总结:

本文探讨利用基础模型的上下文学习能力,无需微调即可从文本自动生成知识图谱,以降低人工成本并惠及小型组织。

摘要:

知识图谱能够以结构化和语义丰富的方式,利用实体及其关系表示现实世界的信息,并支持问答、推荐系统、语义搜索和高级分析等多种下游应用。然而,目前构建知识图谱涉及大量人工工作,这在一定程度上阻碍了其在某些场景中的应用,而自动化这一过程可能尤其有利于小型组织。从大量自然语言中自动生成结构化知识图谱仍然是一项具有挑战性的任务,而针对命名实体提取、关系提取、实体和关系链接以及知识图谱构建等子任务的研究,旨在提升从文本自动构建和补全知识图谱的技术水平。近年来,具有数十亿参数、以自监督方式在大规模训练数据上训练并可适应多种下游任务的基础模型的进步,已在大量自然语言处理(NLP)任务上展示了高性能。在此背景下,一种新兴范式是上下文学习,即直接使用语言模型,通过提供指令和示例的提示来执行任务,而不采用微调等传统方法改变模型参数。这样,无需计算资源进行重新训练或微调模型,且工程工作量极小。因此,利用此类能力从文本生成知识图谱将是有益的。

英文摘要:

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation systems, semantic search, and advanced analytics. However, at the moment, building a knowledge graph involves a lot of manual effort and thus hinders their application in some situations and the automation of this process might benefit especially for small organizations. Automatically generating structured knowledge graphs from a large volume of natural language is still a challenging task and the research on sub-tasks such as named entity extraction, relation extraction, entity and relation linking, and knowledge graph construction aims to improve the state of the art of automatic construction and completion of knowledge graphs from text. The recent advancement of foundation models with billions of parameters trained in a self-supervised manner with large volumes of training data that can be adapted to a variety of downstream tasks has helped to demonstrate high performance on a large range of Natural Language Processing (NLP) tasks. In this context, one emerging paradigm is in-context learning where a language model is used as it is with a prompt that provides instructions and some examples to perform a task without changing the parameters of the model using traditional approaches such as fine-tuning. This way, no computing resources are needed for re-training/fine-tuning the models and the engineering effort is minimal. Thus, it would be beneficial to utilize such capabilities for generating knowledge graphs from text.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑