大多数可用数据是非结构化的,这使得获取有价值的信息变得困难。自动构建知识图谱(KGs)对于结构化数据并使其可访问至关重要,它使用户能够有效地搜索信息。知识图谱还有助于洞察、推理和推断。传统的自然语言处理方法,如命名实体识别和关系抽取,是信息检索中的关键技术,但面临一些局限性,包括使用预定义实体类型以及需要监督学习。当前的研究利用大语言模型的能力,例如零样本或少样本学习。然而,未解决且在语义上重复的实体和关系仍然带来挑战,导致图谱不一致,并需要大量的后处理。此外,大多数方法依赖于特定主题。在本文中,我们提出了 iText2KG,一种无需后处理、增量式且与主题无关的知识图谱构建方法。这种即插即用、零样本的方法适用于广泛的知识图谱构建场景,包含四个模块:文档蒸馏器(Document Distiller)、增量式实体抽取器(Incremental Entity Extractor)、增量式关系抽取器(Incremental Relation Extractor)以及图谱集成与可视化器(Graph Integrator and Visualization)。我们的方法在三种场景下相较于基线方法展示了更优越的性能:将科学论文转换为图谱、将网站转换为图谱以及将简历转换为图谱。
英文摘要:
Most available data is unstructured, making it challenging to access valuable information. Automatically building Knowledge Graphs (KGs) is crucial for structuring data and making it accessible, allowing users to search for information effectively. KGs also facilitate insights, inference, and reasoning. Traditional NLP methods, such as named entity recognition and relation extraction, are key in information retrieval but face limitations, including the use of predefined entity types and the need for supervised learning. Current research leverages large language models' capabilities, such as zero- or few-shot learning. However, unresolved and semantically duplicated entities and relations still pose challenges, leading to inconsistent graphs and requiring extensive post-processing. Additionally, most approaches are topic-dependent. In this paper, we propose iText2KG, a method for incremental, topic-independent KG construction without post-processing. This plug-and-play, zero-shot method is applicable across a wide range of KG construction scenarios and comprises four modules: Document Distiller, Incremental Entity Extractor, Incremental Relation Extractor, and Graph Integrator and Visualization. Our method demonstrates superior performance compared to baseline methods across three scenarios: converting scientific papers to graphs, websites to graphs, and CVs to graphs.
RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning through RAG and Incremental Knowledge Graph Learning Integration
Contrastive Regularization over LoRA for Multimodal Biomedical Image Incremental Learning
School of Computer Science and Engineering, Central South University(计算机科学与工程学院,中南大学);School of Automation, Central South University(自动化学院,中南大学);School of Computer Science and Technology, Beijing Jiaotong University(计算机科学与技术学院,北京交通大学)
Few-Shot Class-Incremental Learning with Prior Knowledge
East China Normal University(华东师范大学);DiDi(滴滴);Shanghai Jiao Tong University(上海交通大学);Tsinghua Berkeley Shenzhen Institute(清华伯克利深圳学院);Toronto Metropolitan University(多伦多都会大学)
GraphKeeper: Graph Domain-Incremental Learning via Knowledge Disentanglement and Preservation
SKLCCSE, School of Computer Science and Engineering, Beihang University(信息与通信工程学院,北京航空航天大学);Shien-Ming Wu School of Intelligent Engineering, South China University of Technology(智能工程学院,华南理工大学);Key Lab of Education Blockchain and Intelligent Technology, Guangxi Normal University(教育区块链与智能技术重点实验室,广西师范大学)
Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation
ZJU-UIUC Joint Institute at Zhejiang University(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究所);ZJU-UoE Institute at Zhejiang University(浙江大学-爱丁堡大学联合研究所);College of Biomedical Engineering and Instrument Science at Zhejiang University(浙江大学生物医学工程与仪器科学学院);College of Computer Science and Technology in Zhejiang University(浙江大学计算机科学与技术学院)
Teacher Agent: A Knowledge Distillation-Free Framework for Rehearsal-based Video Incremental Learning
Nanjing University of Information Science and Technology(南京信息工程大学);Intellifusion(云天励飞);Australian Institute for Machine Learning(澳大利亚机器学习研究所);the University of Adelaide(阿德莱德大学);University of Electronic Science and Technology of China(电子科技大学)
Towards Continual Knowledge Graph Embedding via Incremental Distillation
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(东南大学新一代人工智能技术与交叉应用教育部重点实验室);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
PKI: Prior Knowledge-Infused Neural Network for Few-Shot Class-Incremental Learning
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security at University of Chinese Academy of Sciences(中国科学院大学网络安全学院);NARI Technology Company Limited(NARI科技有限公司);School of Engineering and Applied Science, the George Washington University(乔治华盛顿大学工程与应用科学学院);Department of Communication Engineering, Shanghai University(上海大学通信工程系)
Harmony: A Unified Framework for Modality Incremental Learning
Peng Cheng Laboratory(鹏城实验室);State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences (UCAS)(中国科学院大学人工智能学院)
Fast and Continual Knowledge Graph Embedding via Incremental LoRA
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);College of Software Engineering, Southeast University(东南大学软件学院)
Reminding the Incremental Language Model via Data-Free Self-Distillation
Key Laboratory of Speech Acoustics and Content Understanding, Institute of Acoustics, China(中国科学院声学研究所语言声学与内容理解重点实验室);University of Chinese Academy of Sciences, Beijing, China(中国科学院大学)
CD^2: Constrained Dataset Distillation for Few-Shot Class-Incremental Learning
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Divide and Conquer: Static-Dynamic Collaboration for Few-Shot Class-Incremental Learning
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Department of Communication Engineering, Shanghai University(上海大学通信工程系)