学习全局假设空间以增强协同推理链
Learning Global Hypothesis Space for Enhancing Synergistic Reasoning Chain
AI总结:
GHS-TDA通过构建全局假设图和拓扑数据分析,提升推理链的稳定性和可解释性,优于现有基线方法。
摘要:
链式推理(CoT)已被证明在复杂任务上显著提高了大型语言模型(LLMs)的推理准确性。然而,由于自回归、逐步生成的范式,现有的CoT方法存在两个根本性的限制。首先,推理过程对早期决定高度敏感:一旦引入初始错误,它倾向于在后续步骤中传播和放大,而缺乏全局协调和修正机制使得此类错误难以纠正,最终导致推理链失真。其次,当前的CoT方法缺乏结构化分析技术来过滤冗余推理并提取关键推理特征,导致推理过程不稳定且可解释性有限。为了解决这些问题,我们提出了GHS-TDA。GHS-TDA首先构建了一个语义丰富的全局假设图,以聚合、对齐和协调多个候选推理路径,从而在局部推理失败时提供替代的全局修正路线。然后,它应用基于持续同调的拓扑数据分析来捕捉稳定的多尺度结构,去除冗余和不一致,并提取更可靠的推理骨架。通过联合利用推理多样性和拓扑稳定性,GHS-TDA实现了自适应收敛,产生高信心和可解释的推理路径,并在多个推理基准测试中在准确性和鲁棒性方面均优于强基线。
英文摘要:
Chain-of-Thought (CoT) has been shown to significantly improve the reasoning accuracy of large language models (LLMs) on complex tasks. However, due to the autoregressive, step-by-step generation paradigm, existing CoT methods suffer from two fundamental limitations. First, the reasoning process is highly sensitive to early decisions: once an initial error is introduced, it tends to propagate and amplify through subsequent steps, while the lack of a global coordination and revision mechanism makes such errors difficult to correct, ultimately leading to distorted reasoning chains. Second, current CoT approaches lack structured analysis techniques for filtering redundant reasoning and extracting key reasoning features, resulting in unstable reasoning processes and limited interpretability. To address these issues, we propose GHS-TDA. GHS-TDA first constructs a semantically enriched global hypothesis graph to aggregate, align, and coordinate multiple candidate reasoning paths, thereby providing alternative global correction routes when local reasoning fails. It then applies topological data analysis based on persistent homology to capture stable multi-scale structures, remove redundancy and inconsistencies, and extract a more reliable reasoning skeleton. By jointly leveraging reasoning diversity and topological stability, GHS-TDA achieves self-adaptive convergence, produces high-confidence and interpretable reasoning paths, and consistently outperforms strong baselines in terms of both accuracy and robustness across multiple reasoning benchmarks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。