arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.05366cs.AIcs.CLcs.IR
收藏

Search-o1:智能体搜索增强的大型推理模型

Search-o1: Agentic Search-Enhanced Large Reasoning Models

Renmin University of China(中国人民大学);Tsinghua University(清华大学)

Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, Zhicheng Dou

AI总结:

本文提出 Search-o1 框架,通过智能体 RAG 搜索工作流和 Reason-in-Documents 文档精炼模块增强大型推理模型,并在科学、数学、编程及六个开放域 QA 基准上验证其性能提升。

摘要:

像 OpenAI-o1 这样的大型推理模型(LRM)已通过大规模强化学习展现出令人瞩目的长程逐步推理能力。然而,其扩展的推理过程经常受到知识不足的困扰,从而导致频繁出现不确定性和潜在错误。为解决这一局限,我们提出 Search-o1,这是一个利用智能体检索增强生成(RAG)机制以及用于精炼检索文档的 Reason-in-Documents 模块来增强 LRM 的框架。Search-o1 将智能体搜索工作流集成到推理过程中,使 LRM 在遇到不确定知识点时能够动态检索外部知识。此外,鉴于检索文档冗长繁杂,我们设计了独立的 Reason-in-Documents 模块,在将检索信息注入推理链之前对其进行深入分析,从而最大限度减少噪声并保持连贯的推理流。在科学、数学和编程等复杂推理任务以及六个开放域问答基准上进行的大量实验,证明了 Search-o1 的强劲性能。该方法提升了 LRM 在复杂推理任务中的可信性和适用性,为更可靠、更通用的智能系统铺平了道路。代码可在 https://github.com/sunnynexus/Search-o1 获取。

英文摘要:

Large reasoning models (LRMs) like OpenAI-o1 have demonstrated impressive long stepwise reasoning capabilities through large-scale reinforcement learning. However, their extended reasoning processes often suffer from knowledge insufficiency, leading to frequent uncertainties and potential errors. To address this limitation, we introduce \textbf{Search-o1}, a framework that enhances LRMs with an agentic retrieval-augmented generation (RAG) mechanism and a Reason-in-Documents module for refining retrieved documents. Search-o1 integrates an agentic search workflow into the reasoning process, enabling dynamic retrieval of external knowledge when LRMs encounter uncertain knowledge points. Additionally, due to the verbose nature of retrieved documents, we design a separate Reason-in-Documents module to deeply analyze the retrieved information before injecting it into the reasoning chain, minimizing noise and preserving coherent reasoning flow. Extensive experiments on complex reasoning tasks in science, mathematics, and coding, as well as six open-domain QA benchmarks, demonstrate the strong performance of Search-o1. This approach enhances the trustworthiness and applicability of LRMs in complex reasoning tasks, paving the way for more reliable and versatile intelligent systems. The code is available at \url{https://github.com/sunnynexus/Search-o1}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑