arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2309.13339cs.CLcs.AIcs.LGcs.SC

通过逻辑增强大型语言模型的零样本思维链推理

Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic

University of Hamburg(汉堡大学)

Xufeng Zhao, Mengdi Li, Wenhao Lu, Cornelius Weber, Jae Hee Lee, Kun Chu, Stefan Wermter

AI总结:

本文提出 LoT 框架,利用符号逻辑中的反证法逐步验证和纠正推理过程,显著提升了大型语言模型在多领域的零样本思维链推理能力。

摘要:

大型语言模型的最新进展展示了其在各个领域卓越的泛化能力。然而,它们的推理能力仍有很大的提升空间,尤其是在面对需要多步推理的场景时。尽管大型语言模型拥有广泛的知识,但其推理往往未能有效利用这些知识来建立连贯的思维范式。由于推理过程不受逻辑原则的约束,这些模型有时会出现幻觉。旨在提升大型语言模型的零样本思维链推理能力,我们提出了 LoT (Logical Thoughts),这是一种自我改进的提示框架,利用植根于符号逻辑的原则,特别是反证法,逐步系统地验证和纠正推理过程。在涵盖算术、常识、符号、因果推断和社会问题等不同领域的语言任务上进行的实验评估证明了通过逻辑增强推理的有效性。LoT 的实现代码可在 https://github.com/xf-zhao/LoT 获取。

英文摘要:

Recent advancements in large language models have showcased their remarkable generalizability across various domains. However, their reasoning abilities still have significant room for improvement, especially when confronted with scenarios requiring multi-step reasoning. Although large language models possess extensive knowledge, their reasoning often fails to effectively utilize this knowledge to establish a coherent thinking paradigm. These models sometimes show hallucinations as their reasoning procedures are unconstrained by logical principles. Aiming at improving the zero-shot chain-of-thought reasoning ability of large language models, we propose LoT (Logical Thoughts), a self-improvement prompting framework that leverages principles rooted in symbolic logic, particularly Reductio ad Absurdum, to systematically verify and rectify the reasoning processes step by step. Experimental evaluations conducted on language tasks in diverse domains, including arithmetic, commonsense, symbolic, causal inference, and social problems, demonstrate the efficacy of enhanced reasoning by logic. The implementation code for LoT can be accessed at: https://github.com/xf-zhao/LoT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑