AI Agent

Active Test-time Vision-Language Navigation

Heeju Ko, Sungjune Kim, Gyeongrok Oh, Jeongyoon Yoon, Honglak Lee, Sujin Jang, Seungryong Kim, Sangpil Kim

机构 * Korea University（韩国大学） ； University of Michigan（密歇根大学） ； Samsung AI Center, DS Division（三星人工智能中心，DS部门） ； Korea Advanced Institute of Science & Technology（韩国先进科学技术研究所） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Astra: Toward General-Purpose Mobile Robots via Hierarchical Multimodal Learning

Sheng Chen, Peiyu He, Jiaxin Hu, Ziyang Liu, Yansheng Wang, Tao Xu, Chi Zhang, Chongchong Zhang, Chao An, Shiyu Cai, Duo Cao, Kangping Chen, Shuai Chu, Tianwei Chu, Mingdi Dan, Min Du, Weiwei Fang, Pengyou Fu, Junkai Hu, Xiaowei Jiang, Zhaodi Jiang, Fuxuan Li, Jun Li, Minghui Li, Mingyao Li, Yanchang Li, Zhibin Li, Guangming Liu, Kairui Liu, Lihao Liu, Weizhi Liu, Xiaoshun Liu, Yufei Liu, Yunfei Liu, Qiang Lu, Yuanfei Luo, Xiang Lv, Hongying Ma, Sai Ma, Lingxian Mi, Sha Sa, Hongxiang Shu, Lei Tian, Chengzhi Wang, Jiayu Wang, Kaijie Wang, Qingyi Wang, Renwen Wang, Tao Wang, Wei Wang, Xirui Wang, Chao Wei, Xuguang Wei, Zijun Xia, Zhaohao Xiao, Tingshuai Yan, Liyan Yang, Yifan Yang, Zhikai Yang, Zhong Yin, Li Yuan, Liuchun Yuan, Chi Zhang, Jinyang Zhang, Junhui Zhang, Linge Zhang, Zhenyi Zhang, Zheyu Zhang, Dongjie Zhu, Hang Li, Yangang Zhang

机构 * Full author list in Contributions（完整作者列表） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments Astra Technical Report

SGN-CIRL: Scene Graph-based Navigation with Curriculum, Imitation, and Reinforcement Learning

Nikita Oskolkov, Huzhenyu Zhang, Dmitry Makarov, Dmitry Yudin, Aleksandr Panov

机构 * Moscow Institute of Physics and Technology (MIPT)（莫斯科物理技术学院） ； Federal Research Center for Computer Science and Control of Russian Academy of Sciences（俄罗斯科学院计算机科学与控制联邦研究中心） ； Artificial Intelligence Research Institute (AIRI)（人工智能研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments 7 pages, 11 figures

Learning Rock Pushability on Rough Planetary Terrain

Tuba Girgin, Emre Girgin, Cagri Kilic

机构 * Department of Aerospace Engineering at Embry-Riddle Aeronautical University（艾姆伯-里德航空大学航空航天工程系） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments Paper presented at the Workshop on Field Robotics, ICRA 2025, Atlanta, GA, United States

Future-Oriented Navigation: Dynamic Obstacle Avoidance with One-Shot Energy-Based Multimodal Motion Prediction

Ze Zhang, Georg Hess, Junjie Hu, Emmanuel Dean, Lennart Svensson, Knut Åkesson

机构 * Chalmers University of Technology（查尔姆斯理工大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments Published in IEEE Robotics and Automation Letters (RA-L)

DPO Learning with LLMs-Judge Signal for Computer Use Agents

Man Luo, David Cobbley, Xin Su, Shachar Rosenman, Vasudev Lal, Shao-Yen Tseng, Phillip Howard

机构 * Intel（英特尔） ； Thoughtworks 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

AdvAgent: Controllable Blackbox Red-teaming on Web Agents

Chejian Xu, Mintong Kang, Jiawei Zhang, Zeyi Liao, Lingbo Mo, Mengqi Yuan, Huan Sun, Bo Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments ICML 2025

Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents

Vardaan Pahuja, Yadong Lu, Corby Rosset, Boyu Gou, Arindam Mitra, Spencer Whitehead, Yu Su, Ahmed Awadallah

机构 * The Ohio State University（俄亥俄州立大学） ； Microsoft Research（微软研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments ACL 2025 (Findings)

Disrupting Vision-Language Model-Driven Navigation Services via Adversarial Object Fusion

Chunlong Xie, Jialing He, Shangwei Guo, Jiacheng Wang, Shudong Zhang, Tianwei Zhang, Tao Xiang

机构 * College of Computer Science, Chongqing University（重庆大学计算机学院） ； College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算机与数据科学学院） ； School of Computer Science and Technology, Xidian University（西安电子科技大学计算机科学与技术学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Under review

AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery

Haowei Wang, Junjie Wang, Xiaojun Jia, Rupeng Zhang, Mingyang Li, Zhe Liu, Yang Liu, Qing Wang

机构 * State Key Laboratory of Intelligent Game（智能游戏国家重点实验室） ； Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所） ； University of Chinese Academy of Sciences（中国科学院大学） ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

ScreenExplorer: Training a Vision-Language Model for Diverse Exploration in Open GUI World

Runliang Niu, Jinglong Ji, Yi Chang, Qi Wang

机构 * School of Artificial Intelligence, Jilin University（吉林大学人工智能学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning

Zhengxi Lu, Yuxiang Chai, Yaxuan Guo, Xi Yin, Liang Liu, Hao Wang, Han Xiao, Shuai Ren, Guanjing Xiong, Hongsheng Li

机构 * vivo AI Lab（vivo人工智能实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Updated UI-R1-E-3B

Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning

Xinbin Yuan, Jian Zhang, Kaixin Li, Zhuoxuan Cai, Lujian Yao, Jie Chen, Enguang Wang, Qibin Hou, Jinwei Chen, Peng-Tao Jiang, Bo Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models

Augusto Luis Ballardini, Miguel Ángel Sotelo

机构 * Computer Engineering Department, University of Alcalá（阿尔卡拉大学计算机工程系） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 7 pages, 5 figures, submitted for IEEE conference

Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigation

Chengyang Ying, You Qiaoben, Xinning Zhou, Hang Su, Wenbo Ding, Jianyong Ai

机构 * Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua-Bosch Joint Center for Machine Learning, Institute for Artificial Intelligence, Tsinghua University, Beijing 100084, China（计算机科学与技术系，北京信息科学国家研究中心，清华-博世联合机器学习中心，人工智能研究院，清华大学，北京） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Journal ref Pattern Recognition Letters (PRL), 2023

A Retrieval-Augmented Generation Framework for Academic Literature Navigation in Data Science

Ahmet Yasin Aytar, Kemal Kilic, Kamer Kaya

专题命中 GUI与网页智能体 ：workflow(abstract)；分类 cs.AI

Realistic Counterfactual Explanations for Machine Learning-Controlled Mobile Robots using 2D LiDAR

Sindre Benjamin Remman, Anastasios M. Lekkas

机构 * Department of Engineering Cybernetics, Norwegian University of Science and Technology (NTNU)（工程 cybernetics 系，挪威科学技术大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted for publication at the 2025 European Control Conference (ECC)

CognoSpeak: an automatic, remote assessment of early cognitive decline in real-world conversational speech

Madhurananda Pahar, Fuxiang Tao, Bahman Mirheidari, Nathan Pevy, Rebecca Bright, Swapnil Gadgil, Lise Sproson, Dorota Braun, Caitlin Illingworth, Daniel Blackburn, Heidi Christensen

机构 * School of Computer Science, University of Sheffield, Sheffield, S1 4DP, UK（1 计算机科学学院，谢菲尔德大学，谢菲尔德，S1 4DP，英国） ； Therapy Box, London, UK（2 Therapy Box，伦敦，英国） ； NIHR Devices for Dignity HTC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, S10 2JF, UK（3 NIHR尊严设备HTC，谢菲尔德教学医院国家健康服务基金会信托，谢菲尔德，S10 2JF，英国） ； Sheffield Institute for Translational Neuroscience (SITraN), University of Sheffield, Sheffield, S10 2HQ, UK（4 谢菲尔德转化神经科学研究所（SITraN），谢菲尔德大学，谢菲尔德，S10 2HQ，英国） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments This paper has been accepted for publication in IEEE SSCI 2025. Copyright belongs to IEEE

Journal ref IEEE SSCI, 2025

AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generation

Hao Wen, Shizuo Tian, Borislav Pavlov, Wenjie Du, Yixuan Li, Ge Chang, Shanhui Zhao, Jiacheng Liu, Yunxin Liu, Ya-Qin Zhang, Yuanchun Li

机构 * Institute for AI Industry Research (AIR), Tsinghua University（人工智能产业研究院（AIR），清华大学） ； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Beijing Academy of Artificial Intelligence (BAAI)（北京人工智能研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 13 pages, 5 figures

Towards Autonomous Micromobility through Scalable Urban Simulation

Wayne Wu, Honglin He, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, Bolei Zhou

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.AI

Comments CVPR 2025 Highlight. Project page: https://metadriverse.github.io/urban-sim/

SimPRIVE: a Simulation framework for Physical Robot Interaction with Virtual Environments

Federico Nesti, Gianluca D'Amico, Mauro Marinoni, Giorgio Buttazzo

机构 * Department of Excellence in Robotics & AI（机器人与人工智能卓越部门） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Submitted to IEEE ITSC 2025

Unsupervised Feature Transformation via In-context Generation, Generator-critic LLM Agents, and Duet-play Teaming

Nanxu Gong, Xinyuan Wang, Wangyang Ying, Haoyue Bai, Sixun Dong, Haifeng Chen, Yanjie Fu

机构 * School of Computing and Augmented Intelligence, Arizona State University（计算与增强智能学院，亚利桑那州立大学） ； NEC Laboratories America（NEC美国实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted to IJCAI 2025

Guiding VLM Agents with Process Rewards at Inference Time for GUI Navigation

Zhiyuan Hu, Shiyun Xiong, Yifan Zhang, See-Kiong Ng, Anh Tuan Luu, Bo An, Shuicheng Yan, Bryan Hooi

机构 * National University of Singapore（新加坡国立大学） ； Skywork AI ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

AUTONAV: A Toolfor Autonomous Navigation of Robots

Mir Md Sajid Sarwar, Sudip Samanta, Rajarshi Ray

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 5 pages, 5 figures

The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injections

Chaoran Chen, Zhiping Zhang, Bingcan Guo, Shang Ma, Ibrahim Khalilov, Simret A Gebreegziabher, Yanfang Ye, Ziang Xiao, Yaxing Yao, Tianshi Li, Toby Jia-Jun Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

ATLASv2: LLM-Guided Adaptive Landmark Acquisition and Navigation on the Edge

Mikolaj Walczak, Uttej Kallakuri, Tinoosh Mohsenin

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

AppAgentX: Evolving GUI Agents as Proficient Smartphone Users

Wenjia Jiang, Yangyang Zhuang, Chenxi Song, Xu Yang, Joey Tianyi Zhou, Chi Zhang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

MLANet: Multi-Level Attention Network with Sub-instruction for Continuous Vision-and-Language Navigation

Zongtao He, Liuyi Wang, Shu Li, Qingqing Yan, Chengju Liu, Qijun Chen

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Journal ref Appl Intell 55, 657 (2025)

Explorer: Robust Collection of Interactable GUI Elements

Iason Chaimalas, Arnas Vyšniauskas, Gabriel Brostow

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 19 pages, 17 figures

Efficient Active Imitation Learning with Random Network Distillation

Emilien Biré, Anthony Kobanda, Ludovic Denoyer, Rémy Portelas

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted at ICLR 2025