arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.04094cs.CL
收藏

BloomWise:利用基于布鲁姆分类学启发的提示增强大型语言模型的问题解决能力

BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Prompts

Speech and Language Processing Group, National Technical University of Athens(国家技术大学雅典语音与语言处理组);Institute for Language and Speech Processing, Athena Research Center(雅典研究中心语言与语音处理研究所);National Technical University of Athens(国家技术大学雅典)

Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos, Alexandros Potamianos

AI总结:

BloomWise是一种受布鲁姆分类学启发的提示技术,通过引导LLMs按认知层级逐步推理,在五个数学数据集上提升了问题解决能力和可解释性。

摘要:

尽管大型语言模型(LLMs)在一系列任务中表现出卓越的能力,但数学推理仍然是一个具有挑战性的前沿领域。受到人类在被告知如何思考而非思考什么时学习更有效的观察的启发,我们引入了BloomWise,一种认知启发的提示技术,旨在增强LLMs在数学问题解决上的表现,同时使其解决方案更具可解释性。BloomWise鼓励LLMs通过一系列认知操作——从基础(例如,记忆)到更高级的推理技能(例如,评估)——生成解决方案(以解释的形式),模仿人类构建理解的方式。该过程在这些层级中迭代,如果满足收敛标准则提前停止:具体而言,如果两个或更多连续层级产生相同的答案,则输出最早此类层级的解决方案;否则,该过程持续进行直到所有层级完成。通过在五个流行的数学推理数据集上的广泛实验,我们证明了BloomWise的有效性。我们还提供了全面的消融研究,以分析我们系统中每个组件的优势。

英文摘要:

Despite the remarkable capabilities of large language models (LLMs) across a range of tasks, mathematical reasoning remains a challenging frontier. Motivated by the observation that humans learn more effectively when prompted not what to think but how to think, we introduce BloomWise, a cognitively-inspired prompting technique designed to enhance LLMs' performance on mathematical problem solving while making their solutions more explainable. BloomWise encourages LLMs to generate solutions - in the form of explanations - by progressing through a sequence of cognitive operations-from basic (e.g., remembering) to more advanced reasoning skills (e.g., evaluating) - mirroring how humans build understanding. The process iterates through these levels, halting early if a convergence criterion is met: specifically, if two or more consecutive levels yield the same answer, the solution from the earliest such level is output; otherwise, the process continues until all levels are completed. Through extensive experiments across five popular math reasoning datasets, we demonstrate the effectiveness of BloomWise. We also present comprehensive ablation studies to analyze the strengths of each component within our system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑