arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.11323cs.CL
收藏

大语言模型中性能关键Token的识别与分析

Identifying and Analyzing Performance-Critical Tokens in Large Language Models

Mila

Yu Bai, Heyan Huang, Cesare Spinoso-Di Piano, Marc-Antoine Rondeau, Sanxing Chen, Yang Gao, Jackie Chi Kit Cheung

AI总结:

本文针对大语言模型ICL机制不明确的问题,将提示token分为三类,通过注意力消融实验识别性能关键token,分析其特征与作用,深化对ICL学习机制的理解。

摘要:

上下文学习(In-context learning, ICL)已成为大语言模型(Large Language Models, LLMs)少样本学习的有效解决方案。然而,目前学界对大语言模型如何通过ICL利用示例明确任务并学习对应计算函数的机制仍探索不足。借鉴人类从示例中的内容-标签映射开展学习的方式,我们将ICL提示中的token划分为内容token、停用词token和模板token三类。我们的研究目标是识别出表征会直接影响大语言模型性能的token类型,我们将这一属性称为性能关键性。通过在测试样例的注意力机制中消融对应表征,我们发现,与人类关注信息性词汇的模式不同,信息性内容token的表征对性能的影响弱于模板token和停用词token。我们提供证据表明,性能关键token的表征会聚合来自内容token的信息。此外,我们通过实验证明,词汇语义、重复度和结构线索是这类token的核心区分特征。本研究揭示了大语言模型如何从示例中学习执行任务的机制,深化了我们对不同类型token在大语言模型中所发挥作用的认知。

英文摘要:

In-context learning (ICL) has emerged as an effective solution for few-shot learning with large language models (LLMs). However, how LLMs leverage demonstrations to specify a task and learn a corresponding computational function through ICL is underexplored. Drawing from the way humans learn from content-label mappings in demonstrations, we categorize the tokens in an ICL prompt into content, stopword, and template tokens. Our goal is to identify the types of tokens whose representations directly influence LLM's performance, a property we refer to as being performance-critical. By ablating representations from the attention of the test example, we find that the representations of informative content tokens have less influence on performance compared to template and stopword tokens, which contrasts with the human attention to informative words. We give evidence that the representations of performance-critical tokens aggregate information from the content tokens. Moreover, we demonstrate experimentally that lexical meaning, repetition, and structural cues are the main distinguishing characteristics of these tokens. Our work sheds light on how large language models learn to perform tasks from demonstrations and deepens our understanding of the roles different types of tokens play in large language models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑