arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.00007cs.IRcs.AI
收藏

BaRA: 基于BFS与反思的网络数据收集代理

BaRA: Budget-constrained and Reliable Web Data Collection Agent

Soojeong Lee, Joseph Lee, Yongseong Cho, Sunjae Kim, Youngwoo Moon, Kyungwoo Song

AI总结:

提出BaRA框架,结合有界广度优先搜索和历史自反思,在固定交互预算下高效收集网站级数据,在链接发现和可下载多模态提取上优于现有方法。

摘要:

基于大型语言模型(LLM)的网络代理减少了网络数据收集的手动脚本编写,但在实时网站上,它们常常遗漏相关页面、返回不完整的多模态输出,或返回无法直接下载的媒体URL。我们提出了BFS与反思代理(BaRA),一个在固定交互预算下进行站点级收集的框架。该框架结合了有界广度优先搜索(BFS)遍历和基于历史的自反思。我们在50个具有真实参考集的合成网站上评估了BaRA。此外,我们在三个具有杂乱或动态布局的公共网站上进行了测试。BaRA在链接发现和可下载多模态提取方面优于Pure LLM、SeeAct-Vision和Browser-use,在可下载图像和视频恢复方面提升最大。我们的代码可从此https URL获取。

英文摘要:

Large language model (LLM)-based web agents automate web navigation and data collection. However, live web data collection demands capabilities beyond task completion: agents must discover site-internal pages and retrieve text, image, and video artifacts in an accessible form within a fixed interaction budget. We formulate this setting as budget-constrained, site-level multimodal web data collection and propose Budget-constrained and Reliable Agent (BaRA). BaRA performs breadth-first search (BFS)-based link discovery with liveness verification to filter hallucinated and dead links, then validates extracted multimodal artifacts using rule-based provenance and accessibility checks. A history-based self-reflection module recovers from execution failures and incomplete outputs. On controlled synthetic and real-world websites, BaRA consistently improves valid-link discovery and download-valid multimodal extraction over existing agents. Our code is available at https://github.com/MLAI-Yonsei/BaRA-Agent.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑