arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.03304cs.IR
收藏

是进行搜索还是不进行搜索:通过因果干预对深度搜索代理的决策边界进行对齐

To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal Intervention

City University of Hong Kong(香港城市大学);Huawei Technologies Ltd.(华为技术有限公司)

Wenlin Zhang, Kuicai Dong, Junyi Li, Yingyi Zhang, Xiaopeng Li, Pengyue Jia, Yi Wen, Derong Xu, Maolin Wang, Yichao Wang, Yong Liu, Xiangyu Zhao

AI总结:

本文提出DAS方法,通过因果干预和偏好优化对深度搜索代理的决策边界进行对齐,以解决过度搜索和不足搜索问题,提升搜索效率和准确性。

摘要:

深度搜索代理能够自主地进行多轮基于网络的推理,代表了复杂信息获取任务的一种有前景的范式。然而,当前的代理存在关键的低效问题:它们执行过多的搜索,因为无法准确判断何时停止搜索并开始回答。这源于以结果为导向的训练,优先考虑最终结果而非搜索过程本身。我们发现根本原因是决策边界不一致,即决定积累的信息是否足够回答的阈值。这导致了过度搜索(尽管已有足够知识仍进行冗余搜索)和不足搜索(过早终止导致错误答案)。为了解决这些错误,我们提出了一种综合框架,包含两个关键组成部分。首先,我们引入了基于因果干预的诊断方法,通过在每个决策点比较事实和反事实轨迹来识别边界错误。其次,我们开发了深度搜索代理的决策边界对齐(DAS),通过因果反馈构建偏好数据集,并通过偏好优化对齐策略。在公开数据集上的实验表明,决策边界错误在最先进代理中普遍存在。我们的DAS方法有效校准了这些边界,缓解了过度搜索和不足搜索,从而在准确性和效率上取得了显著的提升。我们的代码和数据可在:https://github.com/Applied-Machine-Learning-Lab/WWW2026_DAS 上公开获取。

英文摘要:

Deep search agents, which autonomously iterate through multi-turn web-based reasoning, represent a promising paradigm for complex information-seeking tasks. However, current agents suffer from critical inefficiency: they conduct excessive searches as they cannot accurately judge when to stop searching and start answering. This stems from outcome-centric training that prioritize final results over the search process itself. We identify the root cause as misaligned decision boundaries, the threshold determining when accumulated information suffices to answer. This causes over-search (redundant searching despite sufficient knowledge) and under-search (premature termination yielding incorrect answers). To address these errors, we propose a comprehensive framework comprising two key components. First, we introduce causal intervention-based diagnosis that identifies boundary errors by comparing factual and counterfactual trajectories at each decision point. Second, we develop Decision Boundary Alignment for Deep Search agents (DAS), which constructs preference datasets from causal feedback and aligns policies via preference optimization. Experiments on public datasets demonstrate that decision boundary errors are pervasive across state-of-the-art agents. Our DAS method effectively calibrates these boundaries, mitigating both over-search and under-search to achieve substantial gains in accuracy and efficiency. Our code and data are publicly available at: https://github.com/Applied-Machine-Learning-Lab/WWW2026_DAS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑