This work explores sequential model editing in large language models (LLMs), a critical task that involves modifying internal knowledge within LLMs continuously through multi-round editing, each incorporating updates or corrections to adjust the model outputs without the need for costly retraining. Existing model editing methods, especially those that alter model parameters, typically focus on single-round editing and often face significant challenges in sequential model editing-most notably issues of model forgetting and failure. To address these challenges, we introduce a new model editing method, namely \textbf{N}euron-level \textbf{S}equential \textbf{E}diting (NSE), tailored for supporting sequential model editing. Specifically, we optimize the target layer's hidden states using the model's original weights to prevent model failure. Furthermore, we iteratively select neurons in multiple layers for editing based on their activation values to mitigate model forgetting. Our empirical experiments demonstrate that NSE significantly outperforms current modifying parameters model editing methods, marking a substantial advancement in the field of sequential model editing. Our code is released on \url{https://github.com/jianghoucheng/NSE}.
Knowledge Editing for Large Language Model with Knowledge Neuronal Ensemble
School of Computer Science and Engineering, Northeastern University（东北大学计算机科学与工程学院）；Artificial Intelligence Innovation Center, Yangtze Delta Region Institute of Tsinghua University, Zhejiang（浙江清华长三角研究院人工智能创新中心）；Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University（东北大学医学影像智能计算教育部重点实验室）
Edit Less, Achieve More: Dynamic Sparse Neuron Masking for Lifelong Knowledge Editing in LLMs
Key Lab of Intell. Info. Process., Inst. of Comput. Tech., CAS（智能信息处理重点实验室，计算技术研究所，中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Agriculture Information Institute, CAAS（农业信息研究所，中国农业科学院）
DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models
Southeast University（东南大学）；Shanghai Jiao Tong University（上海交通大学）；East China Normal University（华东师范大学）；Zhongguancun Academy（中关村学院）；Zhejiang University of Technology（浙江工业大学）；Kuaishou Technology（快手科技）；Northeastern University（东北大学）；Tsinghua University（清华大学）；Nanjing University of Aeronautics and Astronautics（南京航空航天大学）
Finding and Editing Multi-Modal Neurons in Pre-Trained Transformers
University of Science and Technology of China（中国科学技术大学）；School of Computer Science, Fudan University（复旦大学计算机学院）；Tsinghua University（清华大学）；Hefei University of Technology（合肥工业大学）
LyapLock: Bounded Knowledge Preservation in Sequential Large Language Model Editing
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）
Energy-Regularized Sequential Model Editing on Hyperspheres
Columbia University（哥伦比亚大学）；University of California, Los Angeles（加州大学洛杉矶分校）；Zhejiang University（浙江大学）；University of Science and Technology of China（中国科学技术大学）
ACE: Attribution-Controlled Knowledge Editing for Multi-hop Factual Recall
HKUST(GZ) Deep Interdisciplinary Intelligence Lab（香港科技大学(广州)深 interdisciplinary 智能实验室）；BUAA（北京航空航天大学）；HKUST(GZ) Institute of Deep Perception Technology, JITRI Deep Interdisciplinary Intelligence Lab（香港科技大学(广州)深度感知技术研究所，JITRI 深 interdisciplinary 智能实验室）
Output Vector Editing for Memorization Mitigation in Large Language Models
Center for Information and Language Processing, LMU Munich（慕尼黑大学语言与信息处理中心）；Department of Computer Science, University of Copenhagen（哥本哈根大学计算机科学系）；Munich Center for Machine Learning（慕尼黑机器学习中心）；Pioneer Centre for AI（人工智能先锋中心）
The Labyrinth and the Thread: Rethinking Regularizations in Sequential Knowledge Editing for Large Language Models
Bosch Center for Artificial Intelligence (BCAI)（博世人工智能中心（BCAI））；Bosch (China) Investment Ltd.（博世（中国）投资有限公司）；School of Statistics, East China Normal University（东华大学统计学院）
Spectral Characterization and Mitigation of Sequential Knowledge Editing Collapse
Shandong University（山东大学）；School of Computer Science, Beijing University of Posts and Telecommunications（北京邮电大学计算机学院）；Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）
Constraining Sequential Model Editing with Editing Anchor Compression
National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China（中国科学技术大学语音及语言信息处理国家工程研究中心）；Zhejiang University（浙江大学）；University of California, Los Angeles（加利福尼亚大学洛杉矶分校）
Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University（上海交通大学电子信息与电气工程学院）；School of Cyberspace Security, Southeast University（东南大学网络空间安全学院）
EvoEdit: Evolving Null-space Alignment for Robust and Efficient Knowledge Editing
Institute for Clarity in Documentation（文档清晰度研究所）；Inria Paris-Rocquencourt（法国国家信息与自动化研究所巴黎-罗康库尔中心）；Rajiv Gandhi University（拉吉夫·甘地大学）；Tsinghua University（清华大学）；Palmer Research Laboratories（帕默研究实验室）
MEMLA: Enhancing Multilingual Knowledge Editing with Neuron-Masked Low-Rank Adaptation
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）
Potential and Challenges of Model Editing for Social Debiasing
Zhejiang University School of Engineering（浙江大学工程学院）；Westlake University（西湖大学）；Institute of Advanced Technology, Westlake Institute for Advanced Study（西湖高等研究院先进技术研究所）
Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
University of Science and Technology of China（中国科学技术大学）；City University of Hong Kong（香港城市大学）；Jarvis Research Center（贾维斯研究中心）；Tencent YouTu Lab（腾讯优图实验室）；Peking University（北京大学）
REPAIR: Robust Editing via Progressive Adaptive Intervention and Reintegration
Engineering Center for Space Utilization of Chinese Academy of Sciences（中国科学院空间利用工程技术中心）；University of Chinese Academy of Sciences（中国科学院大学）；School of Computer Science and Engineering（计算机科学与工程学院）；Northeastern University（东北大学）；New York University（纽约大学）；School of Computing（计算机学院）；National University of Singapore（新加坡国立大学）；The Chinese University of Hong Kong（香港中文大学）；Technical University of Munich（慕尼黑技术大学）
