arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.02439cs.LGcs.CV
收藏

WebGym: 通过现实任务扩大视觉网络代理的训练环境

WebGym: Scaling Training Environments for Visual Web Agents with Realistic Tasks

Microsoft(微软);UIUC(伊利诺伊大学香槟分校);CMU(卡内基梅隆大学)

Hao Bai, Alexey Taymanov, Tong Zhang, Aviral Kumar, Spencer Whitehead

AI总结:

WebGym通过大规模现实任务和异步轨迹采样系统提升视觉网络代理训练效果,使基座模型在分布外测试集上的成功率显著提升。

摘要:

我们提出了WebGym,目前最大的开源环境,用于训练现实的视觉网络代理。真实网站非平稳且多样,使人工或小规模任务集无法满足鲁棒策略学习需求。WebGym包含近30万任务,涵盖多样化的现实网站和难度级别,通过简单的强化学习(RL)配方训练代理,利用任务奖励反馈指导学习。为实现RL扩展,我们开发了高吞吐量的异步轨迹采样系统,专门用于网络代理。我们的系统相比朴素实现实现了4-5倍的轨迹加速。其次,我们扩大了任务集的广度、深度和规模,从而实现了持续的性能提升。在WebGym上微调强大的基座视觉语言模型Qwen-3-VL-8B-Instruct,使其在分布外测试集上的成功率从26.2%提升至42.9%,显著优于基于专有模型如GPT-4o和GPT-5-Thinking的代理,后者分别达到27.1%和29.8%。这种提升具有实质性意义,因为我们的测试集仅包含训练期间从未见过的网站任务,不同于许多其他训练视觉网络代理的先前工作。

英文摘要:

We present WebGym, the largest-to-date open-source environment for training realistic visual web agents. Real websites are non-stationary and diverse, making artificial or small-scale task sets insufficient for robust policy learning. WebGym contains nearly 300,000 tasks with rubric-based evaluations across diverse, real-world websites and difficulty levels. We train agents with a simple reinforcement learning (RL) recipe, which trains on the agent's own interaction traces (rollouts), using task rewards as feedback to guide learning. To enable scaling RL, we speed up sampling of trajectories in WebGym by developing a high-throughput asynchronous rollout system, designed specifically for web agents. Our system achieves a 4-5x rollout speedup compared to naive implementations. Second, we scale the task set breadth, depth, and size, which results in continued performance improvement. Fine-tuning a strong base vision-language model, Qwen-3-VL-8B-Instruct, on WebGym results in an improvement in success rate on an out-of-distribution test set from 26.2% to 42.9%, significantly outperforming agents based on proprietary models such as GPT-4o and GPT-5-Thinking that achieve 27.1% and 29.8%, respectively. This improvement is substantial because our test set consists only of tasks on websites never seen during training, unlike many other prior works on training visual web agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑