Editing Conceptual Knowledge for Large Language Models
Zhejiang University(浙江大学);ZJU-Ant Group Joint Research Center for Knowledge Graphs(浙江大学-蚂蚁集团知识图谱联合研究中心);National University of Singapore(新加坡国立大学);Ant Group(蚂蚁集团)
Recently, there has been a growing interest in knowledge editing for Large Language Models (LLMs). Current approaches and evaluations merely explore the instance-level editing, while whether LLMs possess the capability to modify concepts remains unclear. This paper pioneers the investigation of editing conceptual knowledge for LLMs, by constructing a novel benchmark dataset ConceptEdit and establishing a suite of new metrics for evaluation. The experimental results reveal that, although existing editing methods can efficiently modify concept-level definition to some extent, they also have the potential to distort the related instantial knowledge in LLMs, leading to poor performance. We anticipate this can inspire further progress in better understanding LLMs. Our project homepage is available at https://zjunlp.github.io/project/ConceptEdit.
Unveiling the Pitfalls of Knowledge Editing for Large Language Models
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);ZJU-Ant Group Joint Research Center for Knowledge Graphs, Zhejiang University(浙江大学-蚂蚁集团知识图谱联合研究中心);ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University(浙江大学杭州国际科技创新中心);Tencent(腾讯)
Edit Less, Achieve More: Dynamic Sparse Neuron Masking for Lifelong Knowledge Editing in LLMs
Key Lab of Intell. Info. Process., Inst. of Comput. Tech., CAS(智能信息处理重点实验室,计算技术研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Agriculture Information Institute, CAAS(农业信息研究所,中国农业科学院)
Related Knowledge Perturbation Matters: Rethinking Multiple Pieces of Knowledge Editing in Same-Subject
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);People’s Public Security University of China(中国人民公安大学)
Orthogonal Representation Editing: Decoupling Semantic Entanglement in Batch Knowledge Editing of LLMs
School of Computer Science and Technology, Tianjin University(天津大学计算机科学与技术学院);Kexin Technology(可心科技);University of Chinese Academy of Sciences(中国科学院大学);Tencent Hunyuan(腾讯混元);College of Computer Science, Chongqing University(重庆大学计算机学院)
Assessing Knowledge Editing in Language Models via Relation Perspective
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, CAS(中国科学院自动化研究所);Kunming University of Science and Technology(昆明理工大学);Beijing Institute of Technology(北京理工大学)
MILA - Quebec AI Institute(MILA - 魁北克人工智能研究所);Microsoft(微软公司);UNC Chapel Hill(北卡罗来纳大学教堂山分校);North Carolina State University(北卡罗来纳州立大学);Massachusetts Institute of Technology(麻省理工学院);Google DeepMind(谷歌DeepMind)
Knowledge in Superposition: Unveiling the Failures of Lifelong Knowledge Editing for Large Language Models
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Commonsense Knowledge Editing Based on Free-Text in LLMs
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院)
Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
University of Science and Technology of China(中国科学技术大学);City University of Hong Kong(香港城市大学);Jarvis Research Center(贾维斯研究中心);Tencent YouTu Lab(腾讯优图实验室);Peking University(北京大学)
WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMs
Tübingen AI Center, University of Tübingen(图宾根人工智能中心,图宾根大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Technical University, Munich(慕尼黑技术大学);University of Virginia(弗吉尼亚大学)
Locate-then-edit for Multi-hop Factual Recall under Knowledge Editing
Peking University(北京大学);Provable Responsible AI and Data Analytics (PRADA) Lab(可验证负责任人工智能与数据分析(PRADA)实验室);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);South China University of Technology(华南理工大学)
COMPKE: Complex Question Answering under Knowledge Editing
Provable Responsible AI and Data Analytics (PRADA) Lab(可证明负责任的人工智能与数据分析实验室);King Abdullah University of Science and Technology(卡布斯大学);Peking University(北京大学);South China University of Technology(华南理工大学);Sun Yat-sen University(中山大学)
Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models
Hefei University of Technology(合肥工业大学);University of Science and Technology of China(中国科学技术大学);Hefei Comprehensive National Science Center(合肥综合性国家科学中心)
Latent Knowledge Scalpel: Precise and Massive Knowledge Editing for Large Language Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Tsinghua University(清华大学);University of Electronic Science and Technology of China(电子科技大学)
Knowledge Graph Enhanced Large Language Model Editing
School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院);School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院)
MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge
BIGAI(北京智源人工智能研究院);Shandong University(山东大学);University of Science and Technology of China(中国科学技术大学);Peking University(北京大学);Beijing Institute of Technology(北京理工大学)
FedAlphaEdit: Null-Space-Aligned Merging for Collaborative Knowledge Editing
Graduate School of Science and Technology, University of Tsukuba(筑波大学科学技术研究生院);Center for Artificial Intelligence Research, Tsukuba Institute for Advanced Research, University of Tsukuba(筑波大学筑波高级研究院人工智能研究中心);Institute of Systems and Information Engineering, University of Tsukuba(筑波大学系统与信息工程研究院)
Constraining Sequential Model Editing with Editing Anchor Compression
National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China(中国科学技术大学语音及语言信息处理国家工程研究中心);Zhejiang University(浙江大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
Knowledge Editing for Large Language Model with Knowledge Neuronal Ensemble
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);Artificial Intelligence Innovation Center, Yangtze Delta Region Institute of Tsinghua University, Zhejiang(浙江清华长三角研究院人工智能创新中心);Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University(东北大学医学影像智能计算教育部重点实验室)