AI Agent

Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models

Yue Zhang, Ziqiao Ma, Jialu Li, Yanyuan Qiao, Zun Wang, Joyce Chai, Qi Wu, Mohit Bansal, Parisa Kordjamshidi

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.CL

Comments Authors contributed equally to this work, and supervisors contributed equal advising to this work; GitHub repository: https://github.com/zhangyuejoslin/VLN-Survey-with-Foundation-Models

Reinforcement Learning with a Focus on Adjusting Policies to Reach Targets

Akane Tsuboya, Yu Kono, Tatsuji Takahashi

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted by AROB-ISBC 2025

NAVCON: A Cognitively Inspired and Linguistically Grounded Corpus for Vision and Language Navigation

Karan Wanchoo, Xiaoye Zuo, Hannah Gonzalez, Soham Dan, Georgios Georgakis, Dan Roth, Kostas Daniilidis, Eleni Miltsakaki

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Falcon-UI: Understanding GUI Before Following User Instructions

Huawen Shen, Chang Liu, Gengluo Li, Xinlong Wang, Yu Zhou, Can Ma, Xiangyang Ji

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments 18 pages, 14 figures

FEAD: Figma-Enhanced App Design Framework for Improving UI/UX in Educational App Development

Tianyi Huang

专题命中 GUI与网页智能体 ：workflow(abstract)；分类 cs.AI

doScenes: An Autonomous Driving Dataset with Natural Language Instruction for Human Interaction and Vision-Language Navigation

Parthib Roy, Srinivasa Perisetla, Shashank Shriram, Harsha Krishnaswamy, Aryan Keskar, Ross Greer

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

OMEGA: Efficient Occlusion-Aware Navigation for Air-Ground Robot in Dynamic Environments via State Space Model

Junming Wang, Xiuxian Guan, Zekai Sun, Tianxiang Shen, Dong Huang, Fangming Liu, Heming Cui

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments Accepted to IEEE RA-L | OccMamba is here!

SANGO: Socially Aware Navigation through Grouped Obstacles

Rahath Malladi, Amol Harsh, Arshia Sangwan, Sunita Chauhan, Sandeep Manjanna

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments Indian Control Conference 2024 (ICC-10)

g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Tasks

Zihan Wang, Gim Hee Lee

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Mixed Strategy Nash Equilibrium for Crowd Navigation

Max Muchen Sun, Francesca Baldini, Katie Hughes, Peter Trautman, Todd Murphey

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments Accepted to The International Journal of Robotics Research (IJRR)

Research on reinforcement learning based warehouse robot navigation algorithm in complex warehouse layout

Keqin Li, Lipeng Liu, Jiajing Chen, Dezhi Yu, Xiaofan Zhou, Ming Li, Congyu Wang, Zhao Li

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

To Ask or Not to Ask? Detecting Absence of Information in Vision and Language Navigation

Savitha Sam Abraham, Sourav Garg, Feras Dayoub

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Accepted at WACV 2025

MPVO: Motion-Prior based Visual Odometry for PointGoal Navigation

Sayan Paul, Ruddra dev Roychoudhury, Brojeshwar Bhowmick

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Accepted in 50SFM Workshop of the 18th European Conference on Computer Vision (ECCV) 2024

Harnessing Webpage UIs for Text-Rich Visual Understanding

Junpeng Liu, Tianyue Ou, Yifan Song, Yuxiao Qu, Wai Lam, Chenyan Xiong, Wenhu Chen, Graham Neubig, Xiang Yue

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

OS-ATLAS: A Foundation Action Model for Generalist GUI Agents

Zhiyong Wu, Zhenyu Wu, Fangzhi Xu, Yian Wang, Qiushi Sun, Chengyou Jia, Kanzhi Cheng, Zichen Ding, Liheng Chen, Paul Pu Liang, Yu Qiao

专题命中 GUI与网页智能体 ：agentic(abstract)；分类 cs.CL

Explainable Behavior Cloning: Teaching Large Language Model Agents through Learning by Demonstration

Yanchu Guan, Dong Wang, Yan Wang, Haiqing Wang, Renen Sun, Chenyi Zhuang, Jinjie Gu, Zhixuan Chu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments 20 pages

Large Language Model-Driven Curriculum Design for Mobile Networks

Omar Erak, Omar Alhussein, Shimaa Naser, Nouf Alabbasi, De Mi, Sami Muhaidat

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments To appear in IEEE/CIC ICCC

Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding

Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Parallel Reinforcement Learning Simulation for Visual Quadrotor Navigation

Jack Saunders, Sajad Saeedi, Wenbin Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments This work has been submitted to the IEEE International Conference on Robotics and Automation (ICRA) for possible publication

ANAVI: Audio Noise Awareness using Visuals of Indoor environments for NAVIgation

Vidhi Jain, Rishi Veerapaneni, Yonatan Bisk

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 8th Conference on Robot Learning (CoRL) 2024

Zero-Shot Vision-and-Language Navigation with Collision Mitigation in Continuous Environment

Seongjun Jeong, Gi-Cheon Kang, Joochan Kim, Byoung-Tak Zhang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?

Ori Yoran, Samuel Joseph Amouyal, Chaitanya Malaviya, Ben Bogin, Ofir Press, Jonathan Berant

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Long-distance Geomagnetic Navigation in GNSS-denied Environments with Deep Reinforcement Learning

Wenqi Bai, Xiaohui Zhang, Shiliang Zhang, Songnan Yang, Yushuai Li, Tingwen Huang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questions

Shicheng Liu, Sina J. Semnani, Harold Triedman, Jialiang Xu, Isaac Dan Zhao, Monica S. Lam

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments Findings of EMNLP 2024

NavTopo: Leveraging Topological Maps For Autonomous Navigation Of a Mobile Robot

Kirill Muravyev, Konstantin Yakovlev

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments This paper is published in proceedings of the 9th International Conference "Interactive Collaborative Robotics" (ICR 2024)

Journal ref International Conference on Interactive Collaborative Robotics. - Cham : Springer Nature Switzerland, 2024. - P. 144-157

Reasoning about the Unseen for Efficient Outdoor Object Navigation

Quanting Xie, Tianyi Zhang, Kedi Xu, Matthew Johnson-Roberson, Yonatan Bisk

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 6 pages, 7 figures

TOP-Nav: Legged Navigation Integrating Terrain, Obstacle and Proprioception Estimation

Junli Ren, Yikai Liu, Yingru Dai, Junfeng Long, Guijin Wang

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments Published on CoRL 2024

Reactive Multi-Robot Navigation in Outdoor Environments Through Uncertainty-Aware Active Learning of Human Preference Landscape

Chao Huang, Wenshuo Zang, Carlo Pinciroli, Zhi Jane Li, Taposh Banerjee, Lili Su, Rui Liu

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Vision-Language Navigation with Continual Learning

Zhiyuan Li, Yanfeng Lv, Ziqin Tu, Di Shang, Hong Qiao

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Fast End-to-End Generation of Belief Space Paths for Minimum Sensing Navigation

Lukas Taus, Vrushabh Zinage, Takashi Tanaka, Richard Tsai

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG