SPoT:通过软提示转移实现更好的冻结模型自适应
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer
摘要:
人们对参数有效的方法越来越感兴趣,以将预训练的语言模型应用于下游任务。基于Lester等人的提示微调方法(2021),该方法学习特定于任务的软提示来调节冻结的预训练模型以执行不同的任务,我们提出了一种新的基于Prompt的迁移学习方法,称为SPoT:Soft Prompt Transfer。SPoT首先学习一个或多个源任务的提示,然后使用它来初始化目标任务的提示。我们表明,SPoT显着提高性能的提示微调在许多任务。更值得注意的是,在所有模型大小中,SPoT在SuperGLUE基准测试中的性能都与标准模型调整(微调所有模型参数)相匹配或优于标准模型调整(微调所有模型参数),同时使用的特定于任务的参数减少了27,000倍。为了了解SPoT在哪里最有效,我们对160个组合中的26个NLP任务进行了一项大规模的任务可转移性研究,并证明许多任务可以通过即时转移相互受益。最后,我们提出了一个有效的检索方法,任务提示作为任务嵌入识别类似的任务,并预测一个新的目标任务的最可转移的源任务。
英文摘要:
There has been growing interest in parameter-efficient methods to apply pre-trained language models to downstream tasks. Building on the Prompt Tuning approach of Lester et al. (2021), which learns task-specific soft prompts to condition a frozen pre-trained model to perform different tasks, we propose a novel prompt-based transfer learning approach called SPoT: Soft Prompt Transfer. SPoT first learns a prompt on one or more source tasks and then uses it to initialize the prompt for a target task. We show that SPoT significantly boosts the performance of Prompt Tuning across many tasks. More remarkably, across all model sizes, SPoT matches or outperforms standard Model Tuning (which fine-tunes all model parameters) on the SuperGLUE benchmark, while using up to 27,000x fewer task-specific parameters. To understand where SPoT is most effective, we conduct a large-scale study on task transferability with 26 NLP tasks in 160 combinations, and demonstrate that many tasks can benefit each other via prompt transfer. Finally, we propose an efficient retrieval approach that interprets task prompts as task embeddings to identify similar tasks and predict the most transferable source tasks for a novel target task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。