Decoder-only language models are stateless: hidden representations are discarded after every forward pass and nothing persists across sessions. Jeong (2026a) showed that trained memory adapters give a frozen encoder-decoder backbone persistent latent-space memory, building on the lateral-memory framework of Jeong (2026b,c). Here we ask whether the same principle transfers to the decoder-only setting, where no cross-attention pathway exists and memory must enter through self-attention alone. We adapt six methods -- prefix, parallel cross-attention, KV extension, Hebbian memory, context-gated branch, and slot-based sparse write -- to a frozen GPT-2, training only a small adapter $θ_{mem}$. The write rule is shared; only the read injection changes from decoder cross-attention to self-attention KV prefix or parallel branch. On LoCoMo we find a striking inductive-bias dichotomy: at $1\times$ capacity, three methods with strong architectural priors -- cross-attention (M.2), Hebbian (M.4), and slot write (M.6) -- achieve retained-memory scores of $7-18\%$ and knowledge gains $ΔK$ of $7-10$, while the other three fail ($< 0.4\%$). At $10\times$ capacity all six converge, showing the gap is architectural, not fundamental. Together with the encoder-decoder results of Jeong (2026a) and the brain-inspired modules of Jeong (2026b,c), these findings establish persistent latent-space memory as a general paradigm spanning major transformer families.
PrimeKG-CL: A Continual Graph Learning Benchmark on Evolving Biomedical Knowledge Graphs
Technology, Innovation, Entrepreneurship Department(技术、创新与创业系);King Abdullah University of Science and Technology(国王阿卜杜勒阿齐兹大学);School of Computing and Information Systems(计算与信息系);The University of Melbourne(墨尔本大学);College of Computer Science and Technology(计算机科学与技术学院);School of Computing Technologies(计算技术学院);Jilin University(吉林大学);RMIT University(皇家墨尔本理工大学);Department of Systems Engineering and Engineering Management(系统工程与工程管理系);The Chinese University of Hong Kong(香港中文大学);Department of Data Science and Artificial Intelligence(数据科学与人工智能系);Hong Kong Polytechnic University(香港理工大学)
Universal Activation Verbalizer: A Unified Framework for Cross-Model Activation Explanation
New Jersey Institute of Technology(新泽西理工学院);University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校);Cisco Research(思科研究);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))