arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2206.14858cs.CLcs.AIcs.LG
收藏

用语言模型解决定量推理问题

Solving Quantitative Reasoning Problems with Language Models

Google Research(谷歌研究院)
Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhua… 展开作者

Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra

摘要:

语言模型在需要自然语言理解的广泛任务上取得了卓越的性能。然而,最先进的模型通常难以处理需要定量推理的任务,例如解决大学水平的数学,科学和工程问题。为了帮助缩小这一差距,我们引入了Minerva,这是一个在一般自然语言数据上预训练并在技术内容上进一步训练的大语言模型。该模型在不使用外部工具的情况下实现了技术基准的最先进性能。我们还评估了我们的模型在物理学,生物学,化学,经济学和其他需要定量推理的科学中的200多个本科生水平的问题,并发现该模型可以正确回答近三分之一的问题。

英文摘要:

Language models have achieved remarkable performance on a wide range of tasks that require natural language understanding. Nevertheless, state-of-the-art models have generally struggled with tasks that require quantitative reasoning, such as solving mathematics, science, and engineering problems at the college level. To help close this gap, we introduce Minerva, a large language model pretrained on general natural language data and further trained on technical content. The model achieves state-of-the-art performance on technical benchmarks without the use of external tools. We also evaluate our model on over two hundred undergraduate-level problems in physics, biology, chemistry, economics, and other sciences that require quantitative reasoning, and find that the model can correctly answer nearly a third of them.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑