AI Agent

TINA: Think, Interaction, and Action Framework for Zero-Shot Vision Language Navigation

Dingbang Li, Wenzhou Chen, Xin Lin

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Actional Atomic-Concept Learning for Demystifying Vision-Language Navigation

Bingqian Lin, Yi Zhu, Xiaodan Liang, Liang Lin, Jianzhuang Liu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Accepted by AAAI 2023

Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Models

Zhen Zhang, Anran Lin, Chun Wai Wong, Xiangyu Chu, Qi Dou, K. W. Samuel Au

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments Accepted by 2024 IEEE International Conference on Robotics and Automation (ICRA), 7 pages, 8 figures

Improving Reliable Navigation under Uncertainty via Predictions Informed by Non-Local Information

Raihan Islam Arnob, Gregory J. Stein

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments IROS 2023

Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation

Mayank Mittal, David Hoeller, Farbod Farshidian, Marco Hutter, Animesh Garg

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Continuous Mean-Zero Disagreement-Regularized Imitation Learning (CMZ-DRIL)

Noah Ford, Ryan W. Gardner, Austin Juhl, Nathan Larson

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

WIPI: A New Web Threat for LLM-Driven Web Agents

Fangzhou Wu, Shutong Wu, Yulong Cao, Chaowei Xiao

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents

Kanzhi Cheng, Qiushi Sun, Yougang Chu, Fangzhi Xu, Yantao Li, Jianbing Zhang, Zhiyong Wu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Interpretable Brain-Inspired Representations Improve RL Performance on Visual Navigation Tasks

Moritz Lange, Raphael C. Engelhardt, Wolfgang Konen, Laurenz Wiskott

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted at XAI4DRL workshop at AAAI 2024

TIAViz: A Browser-based Visualization Tool for Computational Pathology Models

Mark Eastwood, John Pocock, Mostafa Jahanifar, Adam Shephard, Skiros Habib, Ethar Alzaid, Abdullah Alsalemi, Jan Lukas Robertus, Nasir Rajpoot, Shan Raza, Fayyaz Minhas

专题命中 GUI与网页智能体 ：workflow(abstract)；分类 cs.LG

Comments Application note to be submitted to bioinformatics

Active Sensing with Predictive Coding and Uncertainty Minimization

Abdelrahman Sharafeldin, Nabil Imam, Hannah Choi

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments 31 pages, LaTeX; Fixed a small issue with section numbering; Added more experiments, baselines, and relevant references

Beyond Surprise: Improving Exploration Through Surprise Novelty

Hung Le, Kien Do, Dung Nguyen, Svetha Venkatesh

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments 17 pages including Appendix

Stream-based perception for cognitive agents in mobile ecosystems

Jeremias Dötterl, Ralf Bruns, Jürgen Dunkel, Sascha Ossowski

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Journal ref AI Communications, vol. 32, no. 4, pp. 271-286, 2019

Reinforcement Learning from LLM Feedback to Counteract Goal Misgeneralization

Houda Nait El Barj, Theophile Sautory

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Vision-aided UAV navigation and dynamic obstacle avoidance using gradient-based B-spline trajectory optimization

Zhefan Xu, Yumeng Xiu, Xiaoyang Zhan, Baihan Chen, Kenji Shimada

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Journal ref 2023 IEEE International Conference on Robotics and Automation (ICRA)

HomeRobot: Open-Vocabulary Mobile Manipulation

Sriram Yenamandra, Arun Ramachandran, Karmesh Yadav, Austin Wang, Mukul Khanna, Theophile Gervet, Tsung-Yen Yang, Vidhi Jain, Alexander William Clegg, John Turner, Zsolt Kira, Manolis Savva, Angel Chang, Devendra Singh Chaplot, Dhruv Batra, Roozbeh Mottaghi, Yonatan Bisk, Chris Paxton

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 37 pages, 22 figures, 8 tables

Iterative Vision-and-Language Navigation

Jacob Krantz, Shurjo Banerjee, Wang Zhu, Jason Corso, Peter Anderson, Stefan Lee, Jesse Thomason

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments Accepted by CVPR 2023

Exploration-Exploitation Model of Moth-Inspired Olfactory Navigation

Teddy Lazebnik, Yiftach Golov, Roi Gurka, Ally Harari, Alex Liberzon

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

UniTeam: Open Vocabulary Mobile Manipulation Challenge

Andrew Melnik, Michael Büttner, Leon Harz, Lyon Brown, Gora Chand Nandi, Arjun PS, Gaurav Kumar Yadav, Rahul Kala, Robert Haschke

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Vision

Jinli Suo, Weihang Zhang, Jin Gong, Xin Yuan, David J. Brady, Qionghai Dai

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation

Jiaming Wang, Harold Soh

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Under review

GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation

An Yan, Zhengyuan Yang, Wanrong Zhu, Kevin Lin, Linjie Li, Jianfeng Wang, Jianwei Yang, Yiwu Zhong, Julian McAuley, Jianfeng Gao, Zicheng Liu, Lijuan Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Work in progress

Investigating Navigation Strategies in the Morris Water Maze through Deep Reinforcement Learning

Andrew Liu, Alla Borisyuk

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments 28 pages, 16 figures

Find What You Want: Learning Demand-conditioned Object Attribute Space for Demand-driven Navigation

Hongcheng Wang, Andy Guan Hong Chen, Xiaoqi Li, Mingdong Wu, Hao Dong

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments NeurIPS 2023; Project page:https://sites.google.com/view/demand-driven-navigation; Code: https://github.com/whcpumpkin/Demand-driven-navigation

PromptInfuser: How Tightly Coupling AI and UI Design Impacts Designers' Workflows

Savvas Petridis, Michael Terry, Carrie J. Cai

专题命中 GUI与网页智能体 ：workflow(abstract)；分类 cs.AI

Enhanced Low-Dimensional Sensing Mapless Navigation of Terrestrial Mobile Robots Using Double Deep Reinforcement Learning Techniques

Linda Dotto de Moraes, Victor Augusto Kich, Alisson Henrique Kolling, Jair Augusto Bottega, Ricardo Bedin Grando, Anselmo Rafael Cukla, Daniel Fernando Tello Gamarra

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Journal ref 20th IEEE Latin American Robotics Symposium - LARS 2023 and 15th Brazilian Symposium on Robotics- SBR 2023

R2H: Building Multimodal Navigation Helpers that Respond to Help Requests

Yue Fan, Jing Gu, Kaizhi Zheng, Xin Eric Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments EMNLP 2023

Leveraging Topological Maps in Deep Reinforcement Learning for Multi-Object Navigation

Simon Hakenes, Tobias Glasmachers

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Extended Abstract, Northern Lights Deep Learning Conference 2024, 3 pages, 2 figures

ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddings

Arjun Majumdar, Gunjan Aggarwal, Bhavika Devnani, Judy Hoffman, Dhruv Batra

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments code: https://github.com/gunagg/zson

Benchmarking Augmentation Methods for Learning Robust Navigation Agents: the Winning Entry of the 2021 iGibson Challenge

Naoki Yokoyama, Qian Luo, Dhruv Batra, Sehoon Ha

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI