arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.19663cs.CLcs.AI
收藏

识别大型语言模型中的知识编辑类型

Identifying Knowledge Editing Types in Large Language Models

National University of Denfense Technology(国防科技大学)

Xiaopeng Li, Shasha Li, Shangwen Wang, Shezheng Song, Bin Ji, Huijun Liu, Jun Ma, Jie Yu

AI总结:

针对大型语言模型知识编辑的恶意滥用风险,提出知识编辑类型识别任务及KETIBench基准,验证了八个基线识别器在识别有害编辑上的可行性与跨域泛化能力。

摘要:

知识编辑已成为更新大型语言模型(LLMs)知识的高效技术,近年来受到越来越多的关注。然而,目前缺乏有效措施来防止该技术的恶意滥用,这可能导致对LLMs的有害编辑。这些恶意修改可能使LLMs生成有毒内容,误导用户采取不当行为。面对这一风险,我们引入了一个新任务——知识编辑类型识别(KETI),旨在识别LLMs中不同类型的编辑,从而在遇到非法编辑时及时向用户发出警报。作为该任务的一部分,我们提出了KETIBench,其中包含五种有害编辑类型,覆盖最流行的有毒类型,以及一种良性事实编辑。我们开发了五个经典分类模型和三个基于BERT的模型作为开源和闭源LLMs的基线识别器。我们的实验结果涉及92次试验,涵盖四个模型和三种知识编辑方法,表明所有八个基线识别器均取得了不错的识别性能,凸显了识别LLMs中恶意编辑的可行性。进一步的分析显示,识别器的性能与知识编辑方法的可靠性无关,并展现出跨领域泛化能力,从而能够识别来自未知来源的编辑。所有数据和代码均可在https://github.com/xpq-tech/KETI获取。

英文摘要:

Knowledge editing has emerged as an efficient technique for updating the knowledge of large language models (LLMs), attracting increasing attention in recent years. However, there is a lack of effective measures to prevent the malicious misuse of this technique, which could lead to harmful edits in LLMs. These malicious modifications could cause LLMs to generate toxic content, misleading users into inappropriate actions. In front of this risk, we introduce a new task, $\textbf{K}$nowledge $\textbf{E}$diting $\textbf{T}$ype $\textbf{I}$dentification (KETI), aimed at identifying different types of edits in LLMs, thereby providing timely alerts to users when encountering illicit edits. As part of this task, we propose KETIBench, which includes five types of harmful edits covering the most popular toxic types, as well as one benign factual edit. We develop five classical classification models and three BERT-based models as baseline identifiers for both open-source and closed-source LLMs. Our experimental results, across 92 trials involving four models and three knowledge editing methods, demonstrate that all eight baseline identifiers achieve decent identification performance, highlighting the feasibility of identifying malicious edits in LLMs. Additional analyses reveal that the performance of the identifiers is independent of the reliability of the knowledge editing methods and exhibits cross-domain generalization, enabling the identification of edits from unknown sources. All data and code are available in https://github.com/xpq-tech/KETI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑