arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.17557cs.CLcs.LGcs.NE
收藏

大语言模型中Few-Shot记忆的识别、回忆和保持

Recognition, recall, and retention of few-shot memories in large language models

New York University(纽约大学)

A. Emin Orhan

摘要:

现代大语言模型(LLM)的训练发生在这样一种机制中,即在训练过程中,大多数训练样本仅被模型看到几次。对于在训练过程中只见过几次的例子,模型能记住什么?面对新例子的持续训练,这种记忆能持续多久?在这里,我们调查这些问题,通过简单的识别,回忆和保留实验与LLM。在识别实验中,我们询问模型是否可以将所看到的示例与新示例区分开来;在回忆实验中,我们询问模型是否可以正确地回忆起所看到的示例;在保留实验中,我们定期探测模型对原始示例的记忆,因为模型不断使用新示例进行训练。我们发现,即使在非常具有挑战性的识别实验中,单次曝光通常也足以使模型达到近乎完美的精度。我们估计,即使是小的语言模型的识别性能也很容易超过在人类的类似实验中报告的人类识别性能(Shepard,1967)。达到近乎完美的回忆需要更多的曝光,但大多数模型只需3次曝光就可以做到。这种非凡的快速学习能力的另一面是,精确的记忆很快就会被覆盖:原始示例的召回性能在使用新示例进行的前10次训练更新中急剧下降,然后逐渐下降。然而,即使在10万次更新之后,一些原始示例仍然可以近乎完美地回忆起来。在之前的人类长期记忆保持研究中已经观察到了一种定性相似的保持模式(Bahrick,1984)。最后,识别对干扰的鲁棒性要比回忆强得多,并且对自然语言句子的记忆通常优于对无结构刺激的记忆。

英文摘要:

The training of modern large language models (LLMs) takes place in a regime where most training examples are seen only a few times by the model during the course of training. What does a model remember about such examples seen only a few times during training and how long does that memory persist in the face of continuous training with new examples? Here, we investigate these questions through simple recognition, recall, and retention experiments with LLMs. In recognition experiments, we ask if the model can distinguish the seen example from a novel example; in recall experiments, we ask if the model can correctly recall the seen example when cued by a part of it; and in retention experiments, we periodically probe the model's memory for the original examples as the model is trained continuously with new examples. We find that a single exposure is generally sufficient for a model to achieve near perfect accuracy even in very challenging recognition experiments. We estimate that the recognition performance of even small language models easily exceeds human recognition performance reported in similar experiments with humans (Shepard, 1967). Achieving near perfect recall takes more exposures, but most models can do it in just 3 exposures. The flip side of this remarkable capacity for fast learning is that precise memories are quickly overwritten: recall performance for the original examples drops steeply over the first 10 training updates with new examples, followed by a more gradual decline. Even after 100K updates, however, some of the original examples are still recalled near perfectly. A qualitatively similar retention pattern has been observed in human long-term memory retention studies before (Bahrick, 1984). Finally, recognition is much more robust to interference than recall and memory for natural language sentences is generally superior to memory for stimuli without structure.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑