arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

REBASE:跨应用更新的GUI代理设备-云体验一致性

REBASE: Device-Cloud Experience Coherence for GUI Agents Across App Updates

Beining Wu, Jun Huang, Yanxiao Zhao

arXiv 2609.32130首次发表:更新:

发表机构

South Dakota State University; Virginia Commonwealth University(南达科他州立大学; 弗吉尼亚联邦大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

REBASE通过设备-云协同验证与增量证据传输,解决GUI代理跨应用更新时经验失效问题,恢复成功率并大幅降低通信与能耗开销。

AI 中文摘要

随手机发布的图形用户界面(GUI)代理运行一个小型模型并复用经验:即先前运行中记录并缓存在云端的动作路径。当应用更新时,部分经验会悄然失效。在九组真实应用版本对中,携带旧版本记录经验的代理比不带任何经验的代理成功率低10.1个百分点,且代理在采取行动后平均需要3步才能注意到不匹配。我们提出REBASE协议,该协议在版本更新时保持设备端与云端经验副本的一致性。当版本变化时,云端在新版本上重放其副本,设备在执行每个记录步骤前进行验证;当某步骤仍失败时,设备向云端发送逐步增大的证据,从可访问性子树差异开始,直至云端重新推导出可执行的补丁,并以版本为键,使一次修复惠及整个设备群。在两台Jetson设备上,REBASE在一个回合内将过时经验的成功率恢复至新版本上新鲜经验的水平,相比将截图上传至云端,字节数减少708倍,云端调用次数减少47.3倍,且相比无经验运行,设备能耗降低2.5倍。

英文摘要

A graphical user interface (GUI) agent that ships on a phone runs a small model and reuses experience: action paths recorded on earlier runs and cached from the cloud. When an app updates, part of this experience becomes silently wrong. On nine real app version pairs, an agent carrying experience recorded on the old version succeeds 10.1 points less often than one carrying none, and it does not notice the mismatch until 3 steps after acting on it. We propose REBASE, a protocol that keeps the device copy and the cloud copy of the experience coherent across updates. When a version changes, the cloud replays its copy on the new version and the device verifies each recorded step before executing it; when a step still fails, the device sends the cloud evidence in increasing size, starting from an accessibility-subtree diff, until the cloud re-derives an executable patch, keyed by version so that one repair serves the whole fleet. On two Jetson devices, REBASE restores the success rate of stale experience to that of fresh experience recorded on the new version within one episode, at 708x fewer bytes and 47.3x fewer cloud calls than uploading screenshots to the cloud, and 2.5x less device energy than running without experience.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑