arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.12593cs.AIcs.MA
收藏

知晓未知:通过演化生成空间实现智能体数据合成以用于闭环学习

Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning

University of Southern California(南加州大学);AWS AI(亚马逊云科技人工智能部门)

Wei Yang, Qing Ping, Youzhi Luo, Yawei Wang, Abhishek Kumar, Panpan Xu, Jun Huan

AI总结:

针对现有数据合成方法的反馈-决策差距,提出EvoSyn多智能体框架,通过演化生成空间优化合成,在τ²-Bench和CAR-Bench上使平均任务成功率提升13.3个百分点。

摘要:

大型语言模型的持续改进越来越依赖合成经验,但面向交互式智能体的有效数据合成不仅需要可执行且可验证的轨迹,还需要能为当前任务智能体提供学习价值的交互。现有方法虽日益融入环境反馈、数据验证或学习者失败信息,但仍面临反馈到决策的差距:观测到的弱点无法直接指明未来合成应如何改变,也无法确定这些弱点是否可由当前合成空间表示。为解决该差距,我们提出EvoSyn,一种由学习反馈驱动的多智能体框架,其围绕可修订状态组织合成,该状态明确了可刻意生成的交互因素以及合成工作应分配的位置。角色专业化的多智能体系统将学习者反馈转化为合成修订,而Designer(设计器)分配合成方向,Planner(规划器)将其落实为可执行经验。此过程既实现了空间内对薄弱或覆盖不足区域的适配,也实现了合成空间扩展,将新发现的因素提升为显式生成控制。在τ²-Bench和CAR-Bench上的实验表明,EvoSyn相比最强的合成基线将平均任务成功率提升了13.3个百分点,同时生成了更高质量、结构更广泛的合成经验,并发现了无学习者反馈时遗漏的可控因素。

英文摘要:

The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a feedback-to-decision gap: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space. To address this gap, we propose EvoSyn, a learning-feedback-driven multi-agent framework that organizes synthesis around a revisable state specifying what interaction factors can be deliberately generated and where synthesis effort should be allocated. A role-specialized multi-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience. This process enables within-space adaptation toward weak or under-covered regions and synthesis-space expansion that promotes newly discovered factors into explicit generation controls. Experiments on $τ^2$-Bench and CAR-Bench show that EvoSyn improves average task success by 13.3 points over the strongest synthesis baseline, while producing higher-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑