仅凭数据筛选即可稳定上下文学习
Data Curation Alone Can Stabilize In-context Learning
AI总结:
本文提出仅通过数据筛选即可稳定上下文学习(ICL),引入CondAcc和Datamodels两种方法选择训练子集,在不修改ICL算法的前提下显著降低性能方差并提升平均准确率。
摘要:
上下文学习(ICL)通过向大型语言模型(LLM)输入一系列训练样本来使其执行新任务。然而,ICL对训练样本的选择非常敏感:从训练集中随机采样样本会导致性能的高方差。在本文中,我们展示了在不改变ICL算法(例如提示检索或校准)的情况下,精心筛选训练数据子集能极大地稳定ICL性能。我们引入了两种选择训练子集的方法——两者均对训练样本单独评分,然后选择得分最高的样本。CondAcc通过计算一个训练样本与随机训练样本结合时在开发集上的平均ICL准确率来评分,而Datamodels则学习线性回归器来估计每个训练样本的存在如何影响LLM的输出。在五个任务和两个LLM上,从CondAcc和Datamodels选出的稳定子集中采样,相比从整个训练集采样,平均准确率分别提升了7.7%和6.3%。令人惊讶的是,这些稳定子集的样本在内容上并不特别多样化,困惑度也不低,这与其他认为多样性和困惑度在提示LLM时很重要的研究相反。
英文摘要:
In-context learning (ICL) enables large language models (LLMs) to perform new tasks by prompting them with a sequence of training examples. However, it is known that ICL is very sensitive to the choice of training examples: randomly sampling examples from a training set leads to high variance in performance. In this paper, we show that carefully curating a subset of training data greatly stabilizes ICL performance without any other changes to the ICL algorithm (e.g., prompt retrieval or calibration). We introduce two methods to choose training subsets -- both score training examples individually, then select the highest-scoring ones. CondAcc scores a training example by its average dev-set ICL accuracy when combined with random training examples, while Datamodels learns linear regressors that estimate how the presence of each training example influences LLM outputs. Across five tasks and two LLMs, sampling from stable subsets selected by CondAcc and Datamodels improves average accuracy over sampling from the entire training set by 7.7% and 6.3%, respectively. Surprisingly, the stable subset examples are not especially diverse in content or low in perplexity, in contrast with other work suggesting that diversity and perplexity are important when prompting LLMs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。