arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.03845cs.CL
收藏

平行探针:通过二维探测实现高效的并行思维

Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing

University of Maryland, College, Park(马里兰大学);Washington University in St. Louis(圣路易斯华盛顿大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)

Tong Zheng, Chengsong Huang, Runpeng Dai, Yun He, Rui Liu, Xin Ni, Huiwen Bao, Kaishen Wang, Hongtu Zhu, Jiaxin Huang, Furong Huang, Heng Huang

AI总结:

Parallel-Probe通过二维探测技术优化并行思维,实现高效推理,减少令牌消耗并保持准确性。

摘要:

并行思维作为一种有前景的推理范式,却带来了显著的计算负担。现有的效率方法主要依赖局部的轨迹信号,缺乏系统机制来利用并行分支中的全局动态。我们引入了二维探测,这是一种接口,通过周期性地从所有分支中获取中间答案,暴露并行思维的宽深动态。我们的分析揭示了三个关键见解:宽度-深度分配中的非单调扩展、异质推理分支长度以及全局共识的早期稳定。基于这些见解,我们引入了Parallel-Probe,一种无需训练的控制器,旨在优化在线并行思维。Parallel-Probe采用基于共识的提前停止来调节推理深度,并采用基于偏差的分支修剪来动态调整宽度。在三个基准和多种模型上的广泛实验表明,Parallel-Probe在测试时间扩展中建立了优越的帕累托前沿。与标准多数投票相比,它在保持竞争力的准确性的同时,将顺序令牌减少高达35.8%,总令牌成本降低超过25.8%。

英文摘要:

Parallel thinking has emerged as a promising paradigm for reasoning, yet it imposes significant computational burdens. Existing efficiency methods primarily rely on local, per-trajectory signals and lack principled mechanisms to exploit global dynamics across parallel branches. We introduce 2D probing, an interface that exposes the width-depth dynamics of parallel thinking by periodically eliciting intermediate answers from all branches. Our analysis reveals three key insights: non-monotonic scaling across width-depth allocations, heterogeneous reasoning branch lengths, and early stabilization of global consensus. Guided by these insights, we introduce $\textbf{Parallel-Probe}$, a training-free controller designed to optimize online parallel thinking. Parallel-Probe employs consensus-based early stopping to regulate reasoning depth and deviation-based branch pruning to dynamically adjust width. Extensive experiments across three benchmarks and multiple models demonstrate that Parallel-Probe establishes a superior Pareto frontier for test-time scaling. Compared to standard majority voting, it reduces sequential tokens by up to $\textbf{35.8}$% and total token cost by over $\textbf{25.8}$% while maintaining competitive accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑