arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.03461cs.AI
收藏

什么使得交互轨迹对训练终端代理有效?

What Makes Interaction Trajectories Effective for Training Terminal Agents?

The University of Hong Kong(香港大学);Huawei Technologies(华为技术有限公司);Nanyang Technological University(南洋理工大学)

Sidi Yang, Chaofan Tao, Jierun Chen, Tiezheng Yu, Ruoyu Wang, Yuxin Jiang, Yiming Du, Wendong Xu, Jing Xiong, Taiqiang Wu, Lifeng Shang, Xiaohui Li, Ngai Wong, Haoli Bai

AI总结:

本文通过Terminal-Lego流水线研究交互轨迹的教学效能,发现低分代理(DeepSeek-V3.2)的轨迹比高分代理(Claude Opus 4.6)更能提升学生泛化能力,归因于环境接地监督(EGS),并展示了极佳的数据效率。

摘要:

更强的代码代理通常被认为是训练后阶段的更优教师,然而这一假设尚未与任务难度、框架设计和学生能力充分解耦。我们使用Terminal-Lego(一个可扩展的流水线,将多领域现实问题转化为环境验证的代理任务)来研究这种教学联系。令人惊讶的是,独立表现并不能决定教学效能:尽管Claude Opus 4.6在Terminal-Bench 2.0上获得更高分数,但使用来自较低分代理DeepSeek-V3.2的轨迹进行微调的学生表现出显著更强的泛化能力。我们将这种“教学悖论”归因于环境接地监督(EGS):通过框架可见交互明确暴露“检查-行动-验证”行为的轨迹,使学生能够内化稳健的问题解决程序,而非脆弱的动作序列。扩展分析揭示了卓越的数据效率:例如,仅使用15.3k条Terminal-Lego轨迹,Qwen3-32B在Terminal-Bench 2.0上获得了24.3%的分数,与之前使用超过30倍数据量达到的最优性能相当。我们的结果表明,代理训练后的前沿不仅限于结果匹配,而是将焦点转向“框架工程”,其中环境接地交互结构的系统设计成为可复现和可泛化的代理智能的主要催化剂。

英文摘要:

Stronger code agents are commonly assumed to be superior teachers for post-training, yet this assumption remains poorly disentangled from task difficulty, harness design, and student capacity. We investigate this pedagogical link using Terminal-Lego, a scalable pipeline that transforms multi-domain real-world issues into environment-verified agentic tasks. Surprisingly, standalone performance does not dictate teaching efficacy: while Claude Opus 4.6 achieves higher scores on Terminal-Bench 2.0, students fine-tuned on trajectories from DeepSeek-V3.2, a lower-scoring agent, exhibit significantly stronger generalization. We attribute this "pedagogical paradox" to Environment-Grounded Supervision (EGS): trajectories that explicitly expose inspect-act-verify behaviors through harness-visible interactions allow students to internalize robust problem-solving routines rather than fragile action sequences. Scaling analysis reveals exceptional data efficiency: with only 15.3k Terminal-Lego trajectories, for example, Qwen3-32B achieves a 24.3% score on Terminal-Bench 2.0, rivaling previous SOTA performance established with over 30x the data volume. Our results suggest that the frontier of agent post-training lies beyond mere outcome-matching, shifting the focus toward "Harness Engineering", where the systematic design of environment-grounded interaction structures serves as the primary catalyst for reproducible and generalizable agentic intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑