arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.01779cs.CL
收藏

MathLearner:一个用于学习解决数学问题的大语言模型智能体框架

MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems

Beijing-Dublin International College, Beijing University of Technology(北京工业大学北京-都柏林国际学院)

Wenbei Xie, Donglin Liu, Haoran Yan, Wenjie Wu, Zongyang Liu

AI总结:

本文提出MathLearner智能体框架,通过归纳推理模拟人类学习过程,结合高效检索利用外部知识,使数学推理准确率较思维链基线提升20.96%,并解决17.54%基线无法解决的问题。

摘要:

随着人工智能(AI)的发展,大语言模型(LLM)在许多领域得到了广泛应用。然而,在数学推理方面,LLM的推理能力仍然非常有限。数学在人类社会的各个方面都发挥着重要作用,是医疗、交通和航空航天等领域的技术保障,因此,在数学领域发展AI大语言模型具有巨大的潜在意义。为了提高大语言模型的数学推理能力,我们提出了一个基于归纳推理的学习解决数学问题的智能体框架。通过模拟人类对已学信息进行泛化并在新推理任务中有效应用先前知识的学习过程,该框架在数学推理过程中表现出优异的性能。与基线方法(思维链)相比,它将全局准确率提高了20.96%,并解决了基线无法解决的17.54%的数学问题。得益于高效的RETRIEVAL方法,我们的模型提高了大语言模型高效利用外部知识的能力,即模型可以基于书面程序进行数学计算。在教育领域,我们的模型可以用作个性化学习辅助工具,从而减少教育资源的分配不均。

英文摘要:

With the development of artificial intelligence (AI), large language models (LLM) are widely used in many fields. However, the reasoning ability of LLM is still very limited when it comes to mathematical reasoning. Mathematics plays an important role in all aspects of human society and is a technical guarantee in the fields of healthcare, transport and aerospace, for this reason, the development of AI big language models in the field of mathematics has great potential significance. To improve the mathematical reasoning ability of large language models, we proposed an agent framework for learning to solve mathematical problems based on inductive reasoning. By emulating the human learning process of generalization of learned information and effective application of previous knowledge in new reasoning tasks, this framework has great performance in the mathematical reasoning process. It improves global accuracy over the baseline method (chain-of-thought) by 20.96% and solves 17.54% of the mathematical problems that the baseline cannot solve. Benefiting from the efficient RETRIEVAL method, our model improves the ability of large language models to efficiently use external knowledge, i.e., the mathematical computation of the model can be based on written procedures. In education, our model can be used as a personalised learning aid, thus reducing the inequality of educational resources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑