arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.04651cs.AI
收藏

搜索,不要猜测:教小语言模型成为有效的搜索代理

Search, Do not Guess: Teaching Small Language Models to Be Effective Search Agents

New York University(纽约大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Nanyang Technological University(南洋理工大学)

Yizhou Liu, Qi Sun, Yulin Chen, Siyue Zhang, Chen Zhao

AI总结:

本文通过评估复杂多跳推理任务,发现小语言模型(SLMs)虽参数较少,但检索工具使用更少且易产生幻觉。提出轻量级微调方法\policy,使SLMs能可靠检索并生成基于证据的答案,提升Bamboogle和HotpotQA性能17.3和15.3分,达到LLM水平。

摘要:

配备搜索工具的代理已成为知识密集型任务的有效解决方案。尽管大型语言模型(LLMs)具有强大的推理能力,但其高计算成本限制了在搜索代理中的实际部署。因此,近期工作集中在将代理行为从LLMs中蒸馏到小语言模型(SLMs)中。通过在复杂多跳推理任务上的全面评估,我们发现尽管参数知识较少,SLMs调用搜索工具的频率较低且更易产生幻觉。为了解决这一问题,我们提出了\policy,一种轻量级微调方法,明确训练SLMs可靠地检索并生成基于检索证据的答案。与从LLMs中蒸馏代理相比,我们的方法在Bamboogle上提高了17.3分,在HotpotQA上提高了15.3分,实现了跨基准的LLM级结果。进一步分析表明,SLMs中的自适应搜索策略往往降低性能,突显了保持一致搜索行为以实现可靠推理的必要性。

英文摘要:

Agents equipped with search tools have emerged as effective solutions for knowledge-intensive tasks. While Large Language Models (LLMs) exhibit strong reasoning capabilities, their high computational cost limits practical deployment for search agents. Consequently, recent work has focused on distilling agentic behaviors from LLMs into Small Language Models (SLMs). Through comprehensive evaluation on complex multi-hop reasoning tasks, we find that despite possessing less parametric knowledge, SLMs invoke search tools less frequently and are more prone to hallucinations. To address this issue, we propose \policy, a lightweight fine-tuning approach that explicitly trains SLMs to reliably retrieve and generate answers grounded in retrieved evidence. Compared to agent distillation from LLMs, our approach improves performance by 17.3 scores on Bamboogle and 15.3 scores on HotpotQA, achieving LLM-level results across benchmarks. Our further analysis reveals that adaptive search strategies in SLMs often degrade performance, highlighting the necessity of consistent search behavior for reliable reasoning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑