arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2606.17209cs.AIcs.IR

超越并行采样:面向智能搜索的多样化查询初始化

Beyond Parallel Sampling: Diverse Query Initialization for Agentic Search

Carnegie Mellon University(卡内基梅隆大学);Instituto Superior Técnico and INESC-ID, University of Lisbon(里斯本大学高等技术学院和INESC-ID);NOVA LINCS, NOVA School of Science and Technology(新里斯本大学科学与技术学院NOVA LINCS)

Sidhaarth Murali, João Coelho, Jingjie Ning, João Magalhães, Bruno Martins, Chenyan Xiong

AI总结:

针对智能搜索中的广度缩放,提出DivInit方法,通过在第一轮生成多样化查询而非独立采样,缓解查询冗余问题,在多跳问答任务中平均提升5-7个点。

摘要:

测试时缩放用于智能搜索通常增加深度(即每个轨迹更多轮次和令牌)或广度(即更多并行展开)。这里我们关注广度缩放,表明标准并行采样收益递减,并将其归因于第一轮的查询冗余。当模型在不同展开中发出相似的第一查询时,线程检索重叠的证据,后续轮次基于此共享检索。我们通过DivInit解决这一限制,这是一种在第一轮无需训练的干预。DivInit不是采样k个独立的第一查询,而是从单次调用中抽取n个候选,选择k < n个多样化的种子,并将它们作为并行轨迹运行。在五个开源模型和八个基准测试中,DivInit始终优于标准并行采样,在匹配计算量的多跳问答上平均提升5到7个点。代码可在https://this URL获取。

英文摘要:

Test-time scaling for agentic search typically increases depth (i.e., more turns and tokens per trajectory) or breadth (i.e., more parallel rollouts). Here we focus on breadth scaling, showing that standard parallel sampling yields diminishing returns, tracing this to query redundancy at the first turn. When models issue similar first queries across rollouts, the threads retrieve overlapping evidence, and subsequent turns are conditioned on this shared retrieval. We address this limitation with DivInit, a training-free intervention at the first turn. Rather than sampling k independent first queries, DivInit draws n candidates from a single call, picks k < n diverse seeds, and runs them as parallel trajectories. Across five open-weight models and eight benchmarks, DivInit consistently improves over standard parallel sampling, with average gains of five to seven points on multi-hop QA at matched compute. Code available at https://github.com/cxcscmu/diverse-query-initialization

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑