arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2505.20013cs.CL

WebCoT:通过在反思、分支与回滚中重构思维链来增强 Web 智能体的推理能力

WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback

Chinese University of Hong Kong(香港中文大学);Tencent AI Lab(腾讯AI实验室)

Minda Hu, Tianqing Fang, Jianshu Zhang, Junyu Ma, Zhisong Zhang, Jingyan Zhou, Hongming Zhang, Haitao Mi, Dong Yu, Irwin King

AI总结:

本文提出 WebCoT,通过将反思与前瞻、分支和回滚等关键推理技能重构为思维链并进行微调蒸馏,显著提升了 Web 智能体在多个基准上的表现。

摘要:

由大型语言模型(LLMs)驱动的 Web 智能体为下一代人工智能展现出前景,但它们在不确定、动态的 Web 环境中有限的推理能力阻碍了稳健部署。在本文中,我们识别了对有效 Web 智能体至关重要的关键推理技能,即反思与前瞻、分支和回滚,并通过将智能体(推理时)的推理算法重构为思维链理由来整理体现这些能力的轨迹数据。我们在智能体自我改进基准 OpenWebVoyager 中进行了实验,并证明通过简单的微调将显著的推理模式蒸馏到骨干 LLM 中可以大幅提升其性能。我们的方法在多个基准上取得了显著改进,包括 WebVoyager、Mind2web-live 和 SimpleQA(网络搜索),凸显了针对 Web 智能体进行定向推理技能增强的潜力。

英文摘要:

Web agents powered by Large Language Models (LLMs) show promise for next-generation AI, but their limited reasoning in uncertain, dynamic web environments hinders robust deployment. In this paper, we identify key reasoning skills essential for effective web agents, i.e., reflection & lookahead, branching, and rollback, and curate trajectory data that exemplifies these abilities by reconstructing the agent's (inference-time) reasoning algorithms into chain-of-thought rationales. We conduct experiments in the agent self-improving benchmark, OpenWebVoyager, and demonstrate that distilling salient reasoning patterns into the backbone LLM via simple fine-tuning can substantially enhance its performance. Our approach yields significant improvements across multiple benchmarks, including WebVoyager, Mind2web-live, and SimpleQA (web search), highlighting the potential of targeted reasoning skill enhancement for web agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑