AI Agent

Aligning Robot Navigation Behaviors with Human Intentions and Preferences

Haresh Karnan

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Haresh Karnan's PhD Dissertation A recording of the defense talk can be accessed here: https://youtu.be/MssiO6g0Gb8

Journal ref The University of Texas at Austin, May 2024

Research on Autonomous Robots Navigation based on Reinforcement Learning

Zixiang Wang, Hao Yan, Yining Wang, Zhengjia Xu, Zhuoyue Wang, Zhizhong Wu

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Effort and Size Estimation in Software Projects with Large Language Model-based Intelligent Interfaces

Claudionor N. Coelho, Hanchen Xiong, Tushar Karayil, Sree Koratala, Rex Shang, Jacob Bollinger, Mohamed Shabar, Syam Nair

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.LG、cs.SE

InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment

Yuxing Long, Wenzhe Cai, Hongcheng Wang, Guanqi Zhan, Hao Dong

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.CL

Comments Submitted to CoRL 2024

Correctable Landmark Discovery via Large Models for Vision-Language Navigation

Bingqian Lin, Yunshuang Nie, Ziming Wei, Yi Zhu, Hang Xu, Shikui Ma, Jianzhuang Liu, Xiaodan Liang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted by TPAMI 2024

Why Only Text: Empowering Vision-and-Language Navigation with Multi-modal Prompts

Haodong Hong, Sen Wang, Zi Huang, Qi Wu, Jiajun Liu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments IJCAI 2024

WebSuite: Systematically Evaluating Why Web Agents Fail

Eric Li, Jim Waldo

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.SE

Vision-and-Language Navigation Generative Pretrained Transformer

Wen Hanlin

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

SPIN: Simultaneous Perception, Interaction and Navigation

Shagun Uppal, Ananye Agarwal, Haoyu Xiong, Kenneth Shaw, Deepak Pathak

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments In CVPR 2024. Website at https://spin-robot.github.io/

Quick and Accurate Affordance Learning

Fedor Scholz, Erik Ayari, Johannes Bertram, Martin V. Butz

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation

Sourav Garg, Krishan Rana, Mehdi Hosseinzadeh, Lachlan Mares, Niko Sünderhauf, Feras Dayoub, Ian Reid

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments Published at ICRA 2024; 9 pages, 8 figures

AIGeN: An Adversarial Approach for Instruction Generation in VLN

Niyati Rawal, Roberto Bigazzi, Lorenzo Baraldi, Rita Cucchiara

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to 7th Multimodal Learning and Applications Workshop (MULA 2024) at the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

Explore and Explain: Self-supervised Navigation and Recounting

Roberto Bigazzi, Federico Landi, Marcella Cornia, Silvia Cascianelli, Lorenzo Baraldi, Rita Cucchiara

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments ICPR 2020

Training a Vision Language Model as Smartphone Assistant

Nicolai Dorka, Janusz Marecki, Ammar Anwar

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2024 workshop on Generative Models for Decision Making

Behavior Trees Enable Structured Programming of Language Model Agents

Richard Kelley

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

WILBUR: Adaptive In-Context Learning for Robust and Accurate Web Agents

Michael Lutz, Arth Bohra, Manvel Saroyan, Artem Harutyunyan, Giovanni Campagna

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

DELAN: Dual-Level Alignment for Vision-and-Language Navigation by Cross-Modal Contrastive Learning

Mengfei Du, Binhao Wu, Jiwen Zhang, Zhihao Fan, Zejun Li, Ruipu Luo, Xuanjing Huang, Zhongyu Wei

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL、cs.LG

Comments Accepted by LREC-COLING 2024

Dual-View Visual Contextualization for Web Navigation

Jihyung Kil, Chan Hee Song, Boyuan Zheng, Xiang Deng, Yu Su, Wei-Lun Chao

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to CVPR 2024

LangNav: Language as a Perceptual Representation for Navigation

Bowen Pan, Rameswar Panda, SouYoung Jin, Rogerio Feris, Aude Oliva, Phillip Isola, Yoon Kim

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

From Two-Dimensional to Three-Dimensional Environment with Q-Learning: Modeling Autonomous Navigation with Reinforcement Learning and no Libraries

Ergon Cugler de Moraes Silva

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Navigation as Attackers Wish? Towards Building Robust Embodied Agents under Federated Learning

Yunchao Zhang, Zonglin Di, Kaiwen Zhou, Cihang Xie, Xin Eric Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

META-GUI: Towards Multi-modal Conversational Agents on Mobile GUI

Liangtai Sun, Xingyu Chen, Lu Chen, Tianle Dai, Zichen Zhu, Kai Yu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments 14 pages, 10 figures

On the Multi-turn Instruction Following for Conversational Web Agents

Yang Deng, Xuan Zhang, Wenxuan Zhang, Yifei Yuan, See-Kiong Ng, Tat-Seng Chua

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.CL

VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation

Jialu Li, Aishwarya Padmakumar, Gaurav Sukhatme, Mohit Bansal

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments AAAI 2024

VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View

Raphael Schumann, Wanrong Zhu, Weixi Feng, Tsu-Jui Fu, Stefan Riezler, William Yang Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted at AAAI 2024

Nav-Q: Quantum Deep Reinforcement Learning for Collision-Free Navigation of Self-Driving Cars

Akash Sinha, Antonio Macaluso, Matthias Klusch

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 28 pages, 12 figures, 4 tables

Modeling Boundedly Rational Agents with Latent Inference Budgets

Athul Paul Jacob, Abhishek Gupta, Jacob Andreas

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Autonomous Large Language Model Agents Enabling Intent-Driven Mobile GUI Testing

Juyeon Yoon, Robert Feldt, Shin Yoo

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.SE

Comments 10 pages

ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing

Hua Shen, Chieh-Yang Huang, Tongshuang Wu, Ting-Hao 'Kenneth' Huang

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.AI、cs.CL

Comments CSCW 2023 Demo. ConvXAI system code: https://github.com/huashen218/convxai.git

Deep Reinforcement Learning for Autonomous Vehicle Intersection Navigation

Badr Ben Elallid, Hamza El Alaoui, Nabil Benamar

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication in the 2023 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT)