PSSD: 通过人类心理结构使大型语言模型实现自我否定
PSSD: Making Large Language Models Self-denial via Human Psyche Structure
AI总结:
本文提出PSSD框架,通过引入人类心理结构设计本我、超我和自我三个多智能体角色,使大型语言模型在内部实现自我否定以高效纠正推理错误,显著提升了推理性能。
摘要:
大型语言模型(LLMs)推理结果准确性的提升引起了研究界的兴趣,其中先驱性研究探索了事后策略来纠正潜在错误。尽管付出了大量努力,但它们都陷入了资源竞争的状态,需要耗费大量的时间和计算成本。造成这种情况的原因在于未能识别这一路线解决方案的根本特征,即LLMs的自我否定。换句话说,LLMs应该自信地判断潜在错误的存在,并谨慎地执行针对性纠正。由于整个过程在LLMs内部进行,难以获得支持性和有说服力的参考依据,而即使承认了错误,仍然缺乏完善隐藏错误的具体步骤。为了应对这些挑战,我们提出了PSSD,它参考并实现了人类心理结构,使得三个不同且相互关联的角色共同促进人类推理。具体而言,PSSD利用了最新的多智能体范式,并进一步通过三个创新设计的角色进行增强:(1)基于直觉的本我角色,基于良性LLMs提供初步尝试;(2)规则驱动的超我角色,总结规则以规范上述尝试,并返回具体关键点作为指导;(3)以脚本为中心的自我角色,吸收所有过程信息以生成可执行脚本,用于最终的答案预测。大量实验表明,所提出的设计不仅更好地增强了推理能力,而且与当前模型无缝集成,实现了卓越的性能。
英文摘要:
The enhance of accuracy in reasoning results of LLMs arouses the community's interests, wherein pioneering studies investigate post-hoc strategies to rectify potential mistakes. Despite extensive efforts, they are all stuck in a state of resource competition demanding significant time and computing expenses. The cause of the situation lies in the failure of identifying the fundamental feature of the solutions in this line, coined as the self-denial of LLMs. In other words, LLMs should confidently determine the potential existence of mistakes and carefully execute the targeted correction. As the whole procedure conducts within LLMs, supporting and persuasive references are hard to acquire, while the absence of specific steps towards refining hidden mistakes persists even when errors are acknowledged. In response to the challenges, we present PSSD, which refers to and implements the human psyche structure such that three distinct and interconnected roles contribute to human reasoning. Specifically, PSSD leverages the recent multi-agent paradigm, and is further enhanced with three innovatively conceived roles: (1) the intuition-based id role that provides initial attempts based on benign LLMs; (2) the rule-driven superego role that summarizes rules to regulate the above attempts, and returns specific key points as guidance; and (3) the script-centric ego role that absorbs all procedural information to generate executable script for the final answer prediction. Extensive experiments demonstrate that the proposed design not only better enhance reasoning capabilities, but also seamlessly integrate with current models, leading to superior performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。