arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.14265cs.CLcs.LG
收藏

STATe-of-Thoughts:用于树状思维的结构化动作模板

STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughts

Technion(以色列理工学院);Princeton University(普林斯顿大学);Independent(独立作者);Hebrew University(希伯来大学)

Zachary Bamberger, Till R. Saenger, Gilad Morad, Ofra Amir, Brandon M. Stewart, Amir Feder

AI总结:

STATe通过结构化动作模板提升文本生成的多样性和可控性,通过显式动作序列捕捉可解释特征,增强生成质量与可解释性。

摘要:

在推理时间计算(ITC)方法中,如Best-of-N和Tree-of-Thoughts,旨在生成高质量且多样的输出候选,但其高温度采样常无法实现有意义的输出多样性。此外,现有ITC方法对推理过程的控制有限,限制了其可解释性。我们提出了STATe Of Thoughts(STATe),一种可解释的ITC方法,通过搜索高层推理模式。STATe用离散且可解释的文本干预取代随机采样:控制器选择编码高层推理选择的动作;生成器根据这些选择生成推理步骤;评估器评分候选物以引导搜索。这种结构化方法带来了三大优势:首先,动作引导的文本干预可靠地影响LLM生成,并产生比温度基采样更大的响应多样性。其次,在论证生成案例研究中,STATe的显式动作序列捕捉了可解释特征,这些特征高度预测输出质量。第三,估计性能与动作选择之间的关联,使我们能够识别有前途但未探索的动作空间区域,并引导生成向这些区域发展。这些结果确立了STATe作为多样且可控文本生成的实用框架,以及理解驱动性能的推理模式的工具。

英文摘要:

Inference-Time-Compute (ITC) methods like Best-of-$n$ and Tree-of-Thoughts are meant to produce output candidates that are both high-quality and diverse, but their use of high-temperature sampling often fails to achieve meaningful output diversity. Moreover, existing ITC methods offer limited control over $\textit{how}$ to perform reasoning, which in turn limits their interpretability. We present $\textbf{STATe-of-Thoughts}$ (STATe), an interpretable ITC method that $\textit{searches}$ over high-level reasoning patterns. STATe branches over discrete and interpretable textual interventions rather than over token-level samples: a $\textit{controller}$ selects actions encoding high-level reasoning choices; a $\textit{generator}$ produces reasoning steps conditioned on those choices; and an $\textit{evaluator}$ scores candidates to guide search. This structured approach yields three main advantages. First, action-guided textual interventions reliably influence LLM generations and produce greater response diversity than temperature-based sampling. Second, in a case study on argument generation, STATe's explicit action sequences capture interpretable features that are highly predictive of output quality. Third, estimating the association between performance and action choices allows us to identify promising yet unexplored regions of the action space and steer generation toward them. STATe is most useful when a task admits multiple solutions and when understanding $\textit{why}$ an output succeeds matters beyond $\textit{whether}$ the output succeeds. Together, these results establish STATe as both a practical framework for diverse and controllable text generation, and as a tool for understanding the reasoning patterns that drive performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑