发表机构
Beijing Key Laboratory of Multimodal Super-Intelligent Security & People AI(北京多模态超智能安全与人民人工智能重点实验室)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本系统针对WebRetriever挑战赛,采用结构化交互优先策略,结合网格辅助视觉定位、分层上下文管理和故障感知执行机制,在协议3中取得59%通过率并获总冠军。
AI 中文摘要
本报告介绍了为WebRetriever挑战赛开发的网页智能体系统。该系统采用结构化交互优先策略,利用语义化网页信息执行常规浏览器操作,仅在结构化表示不足时调用视觉感知。系统引入了三项关键设计:用于难以访问控件的网格辅助视觉定位、用于减少冗余页面和交互历史的分层上下文管理,以及用于稳定多浏览器任务处理的故障感知执行机制。在本地评估中,系统在协议1上实现了高达79%的通过率。在官方协议3竞赛中,系统以八个并发浏览器工作线程实现了59%的通过率,并总体排名第一,赢得了WebRetriever挑战赛。
英文摘要
This report presents the web agent system developed for the WebRetriever Challenge. The system follows a structuredinteraction- first strategy, using semantic webpage information for routine browser operations and invoking visual perception only when structured representations are insufficient. Three key designs are introduced: grid-assisted visual localization for difficult-to-access controls, hierarchical context management for reducing redundant page and interaction history, and fault-aware execution mechanisms for stable multi-browser task processing. The system achieved a pass rate of up to 79% in local evaluation on Protocol 1. In the official Protocol 3 competition, it achieved a 59% pass rate with eight concurrent browser workers and ranked first overall, winning the WebRetriever Challenge.
CommentsWinning Report for the WebRetriever Challenge