arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.04341cs.AI
收藏

Monitor-Generate-Verify (MGV): 形式化语言模型推理的元认知理论

Monitor-Generate-Verify (MGV): Formalising Metacognitive Theory for Language Model Reasoning

socius labs;Centre for Philosophy of Natural and Social Science (CPNSS)(哲学自然与社会科学中心);London School of Economics(伦敦经济学院)

Nick Oh, Fernand Gobet

AI总结:

MGV框架通过引入监控机制,弥补生成-验证范式中监控过程的缺失,以提升语言模型推理的准确性和鲁棒性。

摘要:

测试时推理架构,如遵循生成-验证范式的架构,优先考虑生成和验证,但排除了确定推理何时以及如何开始的监控过程。这种遗漏可能导致前缀主导陷阱,即模型在早期就陷入次优推理路径,很少恢复,导致大约20%的准确率损失。我们通过提出Monitor-Generate-Verify (MGV)框架来填补这一架构空白,该框架是Flavell和Nelson和Narens元认知理论的计算翻译,保留了其心理细节。MGV通过在生成之前添加显式的监控来扩展生成-验证范式,监控捕捉元认知经验(从难度评估到信心判断),并通过验证反馈细化未来的监控。尽管我们未提供实证验证,但MGV提供了一个诊断推理系统组件级失败的词汇,为未来设计提出了具体的架构干预建议,并识别了与资源理性分析的联系,可能将其机制根植于规范性原则中。

英文摘要:

Test-time reasoning architectures such as those following the Generate-Verify paradigm, where a model iteratively refines or verifies its own generated outputs, prioritise generation and verification but exclude the monitoring processes that determine when and how reasoning should begin. This omission may contribute to the prefix dominance trap, in which models commit early to suboptimal reasoning paths and seldom recover, yielding roughly 20% accuracy loss. We address this architectural gap by proposing the Monitor-Generate-Verify (MGV) framework, a computational translation of Flavell's and Nelson and Narens' metacognitive theories that preserves their psychological detail. MGV extends the Generate-Verify paradigm by adding explicit monitoring that captures metacognitive experiences (from difficulty assessments to confidence judgements) before generation begins and refines future monitoring through verification feedback. Though we present no empirical validation, MGV provides a vocabulary for diagnosing component-level failures in reasoning systems, suggests specific architectural interventions for future designs, and identifies connections to resource-rational analysis that may ground its mechanisms in normative principles.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑