arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.08554cs.LGcs.AI

联邦知识图谱去学习:基于扩散模型的方法

Federated Knowledge Graph Unlearning via Diffusion Model

Shandong University(山东大学);Shandong University of Finance and Economics(山东财经大学)

Bingchen Liu, Yuanyuan Fang

AI总结:

本文提出FedDM框架,利用扩散模型生成噪声数据,在联邦知识图谱中实现机器去学习,有效遗忘特定知识同时保持模型整体性能。

摘要:

联邦学习(FL)通过实现模型共享与协作,在保障数据隐私的同时,促进了人工智能技术的发展与应用。知识图谱(KG)嵌入表示通过将实体和关系映射到向量空间,为知识推理和应用提供了基础。联邦知识图谱嵌入使得能够利用来自不同客户端来源的知识,同时保护本地数据的隐私。然而,由于隐私保护以及适应动态数据变化等需求,引发了关于机器去学习(MU)的研究。然而,在遗忘特定数据对模型影响的同时,维持知识图谱嵌入模型的性能是一项挑战。在本文中,我们提出了FedDM,一个专为联邦知识图谱中的机器去学习而设计的新颖框架。利用扩散模型,我们生成噪声数据,以合理的方式减轻特定知识对联邦学习模型的影响,同时保持模型在剩余数据上的整体性能。我们在基准数据集上进行了实验评估,以验证所提出模型的有效性。大量实验表明,FedDM在知识遗忘方面取得了令人满意的结果。

英文摘要:

Federated learning (FL) promotes the development and application of artificial intelligence technologies by enabling model sharing and collaboration while safeguarding data privacy. Knowledge graph (KG) embedding representation provides a foundation for knowledge reasoning and applications by mapping entities and relations into vector space. Federated KG embedding enables the utilization of knowledge from diverse client sources while safeguarding the privacy of local data. However, due to demands such as privacy protection and the need to adapt to dynamic data changes, investigations into machine unlearning (MU) have been sparked. However, it is challenging to maintain the performance of KG embedding models while forgetting the influence of specific forgotten data on the model. In this paper, we propose FedDM, a novel framework tailored for machine unlearning in federated knowledge graphs. Leveraging diffusion models, we generate noisy data to sensibly mitigate the influence of specific knowledge on FL models while preserving the overall performance concerning the remaining data. We conduct experimental evaluations on benchmark datasets to assess the efficacy of the proposed model. Extensive experiments demonstrate that FedDM yields promising results in knowledge forgetting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑