arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01917cs.CL
收藏

GuideWeb: 一个用于真实世界Web UI上的自动应用内引导生成的基准测试

GuideWeb: A Benchmark for Automatic In-App Guide Generation on Real-World Web UIs

Techtouch Inc.(Techtouch公司);University of Chinese Academy of Sciences(中国科学院大学);Shenzhen Institute of Advanced Technology Chinese Academy of Sciences(中国科学院深圳先进技术研究所);Yokohama National University(Yokohama国立大学)

Chengguang Gan, Yoshihiro Tsujii, Yunhao Liang, Tatsunori Mori, Shiwen Ni, Hiroki Itoh

AI总结:

GuideWeb提出一个用于真实世界Web UI的自动应用内引导生成基准测试,通过选择引导目标元素和生成用户意图文本,实验显示其在引导目标预测和生成质量上优于现有基线。

摘要:

数字采用平台(DAP)提供基于网页的覆盖层,通过提供操作指导和上下文提示来帮助用户导航复杂的网站。尽管现代DAP工具使非专业人士能够编写此类指导,但维护这些指南仍然很费力,因为网站布局和功能不断演变,需要反复的手动更新和重新标注。在本工作中,我们介绍了GuideWeb,一个用于真实世界Web UI上的自动应用内引导生成的新基准测试。GuideWeb将任务制定为通过选择网页中的引导目标元素来生成页面级指导,并生成与用户意图一致的简洁引导文本。我们还提出了一套综合的评估套件,共同衡量引导目标元素选择的准确性以及生成意图和引导文本的质量。实验显示,我们提出的GuideWeb Agent在引导目标元素预测方面实现了30.79%的准确性,同时在意图生成方面获得了BLEU分数44.94,在引导文本生成方面获得了21.34分。现有基线表现明显更差,这表明自动引导生成仍然具有挑战性,需要进一步进步,才能在真实世界环境中可靠部署此类系统。

英文摘要:

Digital Adoption Platform (DAP) provide web-based overlays that deliver operation guidance and contextual hints to help users navigate complex websites. Although modern DAP tools enable non-experts to author such guidance, maintaining these guides remains labor-intensive because website layouts and functionalities evolve continuously, which requires repeated manual updates and re-annotation. In this work, we introduce \textbf{GuideWeb}, a new benchmark for automatic in-app guide generation on real-world web UIs. GuideWeb formulates the task as producing page-level guidance by selecting \textbf{guide target elements} grounded in the webpage and generating concise guide text aligned with user intent. We also propose a comprehensive evaluation suite that jointly measures the accuracy of guide target element selection and the quality of generated intents and guide texts. Experiments show that our proposed \textbf{GuideWeb Agent} achieves \textbf{30.79\%} accuracy in guide target element prediction, while obtaining BLEU scores of \textbf{44.94} for intent generation and \textbf{21.34} for guide-text generation. Existing baselines perform substantially worse, which highlights that automatic guide generation remains challenging and that further advances are necessary before such systems can be reliably deployed in real-world settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑