Associative memory inspires improvements for in-context learning using a novel attention residual stream architecture
机构 * SciAI Center, Cornell University, USA(SciAI中心,康奈尔大学,美国) ; Neural Coding and Brain Computing Unit, OIST, Japan(神经编码与脑计算单元,海洋研究所,日本) ; SciAI Center, Center for Applied Mathematics, School of Civil and Environmental Engineering, Cornell University, USA(SciAI中心,应用数学中心,土木与环境工程学院,康奈尔大学,美国)
Comments 35 pages, 14 figures, 6 tables; accepted and published in TMLR