arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.17284cs.AI

HalluClear:诊断、评估和缓解GUI代理中的幻觉

HalluClear: Diagnosing, Evaluating and Mitigating Hallucinations in GUI Agents

MAIS&NLPR, Institute of Automation, Chinese Academy of Sciences(自动化研究所人工智能与自然语言处理实验室,中国科学院);School of Artificial Intelligence, UCAS(中国科学院大学人工智能学院);Meituan(美团)

Chao Jin, Wenkui Yang, Hao Sun, Yuqi Liao, Qianyi Jiang, Kai Zhou, Jie Cao, Ran He, Huaibo Huang

AI总结:

HalluClear通过引入专门的幻觉分类、校准的评估流程和闭环推理方案,有效减少GUI代理中的幻觉,提升自动化可靠性。

摘要:

尽管GUI代理的进步主要由大规模训练推动,但缺乏专门针对幻觉的诊断、评估和缓解工具。HalluClear引入了基于经验失败分析的GUI特定幻觉分类,校准的三阶段评估流程以及基于闭环结构推理的缓解方案,通过专家标注基准和集 credibility 估计提升 VLM-as-a-judge 的可靠性。实验表明,仅使用9K样本进行微调即可显著减少幻觉,提升接地性和行动准确性,为稳健的GUI自动化提供计算高效的路径。

英文摘要:

While progress in GUI agents has been largely driven by industrial-scale training, ungrounded hallucinations often trigger cascading failures in real-world deployments.Unlike general VLM domains, the GUI agent field lacks a hallucination-focused suite for fine-grained diagnosis, reliable evaluation, and targeted mitigation.To bridge this gap, we introduce HalluClear, a comprehensive suite for hallucination mitigation in GUI agents as a complement to computation-intensive scaling. HalluClear comprises: (1) a GUI-specific hallucination taxonomy derived from empirical failure analysis; (2) a calibrated three-stage evaluation workflow which enhances VLM-as-a-judge reliability via expert-annotated benchmarking and ensemble credibility estimation; and (3) a mitigation scheme based on closed-loop structured reasoning, enabling lightweight continual post-training with cold-start initialization for both generalist and GUI-specialist agents. Experiments across representative agents and public benchmarks demonstrate that post-training on only 9K samples within our suite can significantly reduce hallucinations, thereby improving grounding and action fidelity, offering a compute-efficient pathway to robust GUI automation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑