arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.00519cs.CLcs.AI
收藏

利用LEVERWORLDS探索语言模型的学习能力

Exploring the Learning Capabilities of Language Models using LEVERWORLDS

Hebrew University of Jerusalem(耶路撒冷希伯来大学);Columbia University(哥伦比亚大学)

Eitan Wagner, Amir Feder, Omri Abend

AI总结:

本文提出LeverWorlds框架,通过受控实验比较经典学习算法与Transformer语言模型在样本效率上的差异,发现Transformer虽能完成任务但样本效率较低,并探索利用ICL能力改进简单算法的应用。

摘要:

学习随机环境的模型通常既涉及学习一般结构规则,也涉及学习实例的具体属性。本文研究了各种学习方法中一般与具体学习之间的相互作用,重点关注样本效率。我们设计了一个名为LeverWorlds的框架,该框架能够生成简单的受物理学启发的世界,这些世界遵循相似的生成过程但具有不同的分布,并且其实例可以用自然语言表达。这些世界允许进行受控实验,以评估不同学习方法的样本复杂度。我们使用经典学习算法以及Transformer语言模型进行实验,包括微调和上下文学习(ICL)。我们的总体发现是:(1)Transformer通常能成功完成该任务;但(2)它们的样本效率远低于对结构做出更强假设的经典方法,例如最大似然估计和逻辑回归。这一发现与近期将Transformer用作通用估计器的趋势存在张力。我们提出了一种方法,利用当代语言模型的ICL能力来对此类数据应用简单算法。我们的实验表明,模型目前在该任务上仍面临困难,但展现出有希望的潜力。

英文摘要:

Learning a model of a stochastic setting often involves learning both general structure rules and specific properties of the instance. This paper investigates the interplay between learning the general and the specific in various learning methods, with emphasis on sample efficiency. We design a framework called {\sc LeverWorlds}, which allows the generation of simple physics-inspired worlds that follow a similar generative process with different distributions, and their instances can be expressed in natural language. These worlds allow for controlled experiments to assess the sample complexity of different learning methods. We experiment with classic learning algorithms as well as Transformer language models, both with fine-tuning and In-Context Learning (ICL). Our general finding is that (1) Transformers generally succeed in the task; but (2) they are considerably less sample efficient than classic methods that make stronger assumptions about the structure, such as Maximum Likelihood Estimation and Logistic Regression. This finding is in tension with the recent tendency to use Transformers as general-purpose estimators. We propose an approach that leverages the ICL capabilities of contemporary language models to apply simple algorithms for this type of data. Our experiments show that models currently struggle with the task but show promising potential.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑