Enabling artificial intelligence systems, particularly large language models, to update knowledge and flexibly apply it during reasoning remains a central challenge. Existing knowledge editing approaches emphasize atomic facts, improving factual recall but often failing to integrate updated information into a coherent framework usable across contexts. In this work, we argue that knowledge update is fundamentally a reasoning problem rather than a memorization problem. Consequently, a model should be trained in situations where the new information is instrumental to solving a task, combined with pre-existing knowledge, and exercised through multi-step reasoning. Based on this insight, we propose a training strategy based on three principles. First, new knowledge is introduced as a coherent background story that contextualizes novel facts and explains their relation to existing knowledge. Second, models are trained using self-generated multi-hop questions that require multi-step reasoning involving the new information. Third, training is done using knowledge distillation, forcing a student model to internalize the teacher's reasoning behavior without access to the novel information. Experiments show that models trained with this strategy effectively leverage newly acquired knowledge during reasoning and achieve remarkable performance on challenging questions that require combining multiple new facts.
Knowledge Updating? No More Model Editing! Just Selective Contextual Reasoning
School of Economics and Management, East China Normal University(华东师范大学经济与管理学部);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
Is This Just Fantasy? Language Model Representations Reflect Human Judgments of Event Plausibility
Department of Computer Science(计算机科学系);Department of Cognitive Science(认知科学系);Google(谷歌);DeepMind(深度Mind);Brown University(布朗大学);Johns Hopkins University(约翰霍普金斯大学);Department of Cognitive(认知系);Department of Computer Science & Psychological Sciences(计算机科学与心理学科学系)