多模态大模型

Uncertainty in Action: Confidence Elicitation in Embodied Agents

Tianjiao Yu, Vedant Shah, Muntasir Wahed, Kiet A. Nguyen, Adheesh Juvekar, Tal August, Ismini Lourentzou

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Project page: https://plan-lab.github.io/ece/

Automatic Operator-level Parallelism Planning for Distributed Deep Learning -- A Mixed-Integer Programming Approach

Ruifeng She, Bowen Pang, Kai Li, Zehua Liu, Tao Zhong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Closed Loop Interactive Embodied Reasoning for Robot Manipulation

Michal Nazarczuk, Jan Kristof Behrens, Karla Stepanova, Matej Hoffmann, Krystian Mikolajczyk

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to ICRA 2025. Project page: https://michaal94.github.io/CLIER

ACAI for SBOs: AI Co-creation for Advertising and Inspiration for Small Business Owners

Nimisha Karnatak, Adrien Baranes, Rob Marchant, Triona Butler, Kristen Olson

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

CLEA: Closed-Loop Embodied Agent for Enhancing Task Execution in Dynamic Environments

Mingcong Lei, Ge Wang, Yiming Zhao, Zhixin Mai, Qing Zhao, Yao Guo, Zhen Li, Shuguang Cui, Yatong Han, Jinke Ren

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

From Screens to Scenes: A Survey of Embodied AI in Healthcare

Yihao Liu, Xu Cao, Tingting Chen, Yankai Jiang, Junjie You, Minghua Wu, Xiaosong Wang, Mengling Feng, Yaochu Jin, Jintai Chen

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 56 pages, 11 figures, manuscript accepted by Information Fusion

AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials

Yiheng Xu, Dunjie Lu, Zhennan Shen, Junli Wang, Zekun Wang, Yuchen Mao, Caiming Xiong, Tao Yu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments ICLR2025 Spotlight https://agenttrek.github.io

Opus: A Workflow Intention Framework for Complex Workflow Generation

Phillip Kingston, Théo Fagnoni, Mahsun Altin

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 1 Figure, 27 Pages

TRIFFID: Autonomous Robotic Aid For Increasing First Responders Efficiency

Jorgen Cani, Panagiotis Koletsis, Konstantinos Foteinos, Ioannis Kefaloukos, Lampros Argyriou, Manolis Falelakis, Iván Del Pino, Angel Santamaria-Navarro, Martin Čech, Ondřej Severa, Alessandro Umbrico, Francesca Fracasso, AndreA Orlandini, Dimitrios Drakoulis, Evangelos Markakis, Iraklis Varlamis, Georgios Th. Papadopoulos

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Hierarchical Imitation Learning of Team Behavior from Heterogeneous Demonstrations

Sangwon Seo, Vaibhav Unhelkar

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Extended version of an identically-titled paper accepted at AAMAS 2025

PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC

Haowei Liu, Xi Zhang, Haiyang Xu, Yuyang Wanyan, Junyang Wang, Ming Yan, Ji Zhang, Chunfeng Yuan, Changsheng Xu, Weiming Hu, Fei Huang

专题命中 多模态Agent ：MLLM(abstract)；分类 cs.CV

Comments 14 pages, 7 figures

SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World

Jiaqi Zhang, Chen Gao, Liyuan Zhang, Yong Li, Hongzhi Yin

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Model

Chongkai Gao, Haozhuo Zhang, Zhixuan Xu, Zhehao Cai, Lin Shao

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

AgentStudio: A Toolkit for Building General Virtual Agents

Longtao Zheng, Zhiyuan Huang, Zhenghai Xue, Xinrun Wang, Bo An, Shuicheng Yan

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments ICLR 2025. Project page: https://ltzheng.github.io/agent-studio

GUI Agents with Foundation Models: A Comprehensive Survey

Shuai Wang, Weiwen Liu, Jingxuan Chen, Yuqi Zhou, Weinan Gan, Xingshan Zeng, Yuhan Che, Shuai Yu, Xinlong Hao, Kun Shao, Bin Wang, Chuhan Wu, Yasheng Wang, Ruiming Tang, Jianye Hao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent

Rob Royce, Marcel Kaufmann, Jonathan Becktor, Sangwoo Moon, Kalind Carpenter, Kai Pak, Amanda Towler, Rohan Thakker, Shehryar Khattak

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Preprint. Accepted at IEEE Aerospace Conference 2025, 16 pages, 12 figures

Towards CausalGPT: A Multi-Agent Approach for Faithful Knowledge Reasoning via Promoting Causal Consistency in LLMs

Ziyi Tang, Ruilin Wang, Weixing Chen, Yongsen Zheng, Zechuan Chen, Yang Liu, Keze Wang, Tianshui Chen, Liang Lin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 12 pages, 9 figures. 3 tables

LLM-Powered Decentralized Generative Agents with Adaptive Hierarchical Knowledge Graph for Cooperative Planning

Hanqing Yang, Jingdi Chen, Marie Siew, Tania Lorido-Botran, Carlee Joe-Wong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Every Software as an Agent: Blueprint and Case Study

Mengwei Xu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

AccidentBlip: Agent of Accident Warning based on MA-former

Yihua Shao, Yeling Xu, Xinwei Long, Siyu Chen, Ziyang Yan, Yang Yang, Haoting Liu, Yan Wang, Hao Tang, Zhen Lei

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generation

Quanting Xie, So Yeon Min, Pengliang Ji, Yue Yang, Tianyi Zhang, Kedi Xu, Aarav Bajaj, Ruslan Salakhutdinov, Matthew Johnson-Roberson, Yonatan Bisk

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Web: https://quanting-xie.github.io/Embodied-RAG-web/

Generative Planning with 3D-vision Language Pre-training for End-to-End Autonomous Driving

Tengpeng Li, Hanli Wang, Xianfei Li, Wenlong Liao, Tao He, Pai Peng

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Enhancing Path Planning Performance through Image Representation Learning of High-Dimensional Configuration Spaces

Jorge Ocampo Jimenez, Wael Suleiman

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Cyber-Physical Steganography in Robotic Motion Control

Ching-Chun Chang, Yijie Lin, Isao Echizen

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

A little less conversation, a little more action, please: Investigating the physical common-sense of LLMs in a 3D embodied environment

Matteo G. Mecattaf, Ben Slater, Marko Tešić, Jonathan Prunty, Konstantinos Voudouris, Lucy G. Cheke

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 25 pages, 4 figures; v2: Added AFMR Acknowledgment

Multi-Agent Planning Using Visual Language Models

Michele Brienza, Francesco Argenziano, Vincenzo Suriani, Domenico D. Bloisi, Daniele Nardi

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

LLM-based Multi-Agent Systems: Techniques and Business Perspectives

Yingxuan Yang, Qiuying Peng, Jun Wang, Ying Wen, Weinan Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

TravelAgent: Generative Agents in the Built Environment

Ariel Noyman, Kai Hu, Kent Larson

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 21 pages 9 figs

GenPlan: Generative Sequence Models as Adaptive Planners

Akash Karthikeyan, Yash Vardhan Pant

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Accepted in AAAI 2025. Project page: https://aku02.github.io/projects/genplan/

GUI Testing Arena: A Unified Benchmark for Advancing Autonomous GUI Testing Agent

Kangjia Zhao, Jiahui Song, Leigang Sha, Haozhan Shen, Zhi Chen, Tiancheng Zhao, Xiubo Liang, Jianwei Yin

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI