arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.08068cs.CLcs.AI
收藏

教学启发的集成提示框架:增强大型语言模型推理能力的新方法

Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models

The University of Hong Kong(香港大学);Youdao, NetEase, Inc.(网易有道公司)

Wenting Tan, Dongxiao Chen, Jieting Xue, Zihao Wang, Taijie Chen

AI总结:

提出教学启发的集成提示框架,通过模拟教师指导过程为LLMs提供概念、定理和相似问题,并在四个数学基准上取得新的最优性能。

摘要:

大型语言模型(LLMs)在各个领域展现出令人印象深刻的性能,但在算术推理任务上仍然存在困难。最近的研究表明,提示设计方法在增强推理能力方面是有效的。然而,这些方法忽略了成功解决大多数算术推理问题所需的对特定概念、定理和技巧的先验知识这一关键要求。为了解决这个问题,我们提出了一种新颖且有效的教学启发集成框架,它模拟了教师指导学生的教学过程。该方法为LLMs提供了基本概念、相关定理以及具有类似解决方法的相似问题,从而促进推理能力的提升。此外,我们引入了两个新的中文数据集MathMC和MathToF,两者都包含详细的解释和答案。在九个基准上进行的实验表明,我们的方法提高了LLMs的推理准确率。借助GPT-4和我们的框架,我们在四个数学基准(AddSub、SVAMP、Math23K和AQuA)上取得了新的最优性能,准确率分别为98.2%(+3.3%)、93.9%(+0.2%)、94.3%(+7.2%)和81.1%(+1.2%)。我们的数据和代码可在https://github.com/SallyTan13/Teaching-Inspired-Prompting获取。

英文摘要:

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities. However, these approaches overlook crucial requirements for prior knowledge of specific concepts, theorems, and tricks to tackle most arithmetic reasoning problems successfully. To address this issue, we propose a novel and effective Teaching-Inspired Integrated Framework, which emulates the instructional process of a teacher guiding students. This method equips LLMs with essential concepts, relevant theorems, and similar problems with analogous solution approaches, facilitating the enhancement of reasoning abilities. Additionally, we introduce two new Chinese datasets, MathMC and MathToF, both with detailed explanations and answers. Experiments are conducted on nine benchmarks which demonstrates that our approach improves the reasoning accuracy of LLMs. With GPT-4 and our framework, we achieve new state-of-the-art performance on four math benchmarks (AddSub, SVAMP, Math23K and AQuA) with accuracies of 98.2% (+3.3%), 93.9% (+0.2%), 94.3% (+7.2%) and 81.1% (+1.2%). Our data and code are available at https://github.com/SallyTan13/Teaching-Inspired-Prompting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑