多模态大模型

ALAS: A Stateful Multi-LLM Agent Framework for Disruption-Aware Planning

Edward Y. Chang, Longling Geng

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 36 pages, 10 figures, 19 tables

Knowledge-Informed Multi-Agent Trajectory Prediction at Signalized Intersections for Infrastructure-to-Everything

Huilin Yin, Yangwenhui Xu, Jiaxiang Li, Hao Zhang, Gerhard Rigoll

机构 * College of Electronic and Information Engineering, Tongji University（同济大学电子与信息工程学院） ； Shanghai Institute of Intelligent Science and Technology, Tongji University（同济大学上海智能科学与技术研究院） ； Department of Electrical and Computer Engineering, Technical University of Munich（慕尼黑技术大学电子与计算机工程系） 纠错

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Use

Shusen Liu, Haichao Miao, Peer-Timo Bremer

机构 * CASC, Computing, Lawrence Livermore National Laboratory（计算部、劳伦斯利弗莫尔国家实验室） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Embodied Intelligence: The Key to Unblocking Generalized Artificial Intelligence

Jinhao Jiang, Changlin Chen, Shile Feng, Wanru Geng, Zesheng Zhou, Ni Wang, Shuai Li, Feng-Qi Cui, Erbao Dong

机构 * Hefei University of Technology（合肥工业大学） ； University of Science and Technology of China（中国科学技术大学） ； Amazon Development Center Germany GmbH（亚马逊德国开发中心） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 19pages,7 figures,3 tables

Multi-Agent Systems for Robotic Autonomy with LLMs

Junhong Chen, Ziqi Yang, Haoyuan G Xu, Dandan Zhang, George Mylonas

机构 * Imperial College London（伦敦帝国学院） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 11 pages, 2 figures, 5 tables, submitted for publication

Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

Yiheng Xu, Zekun Wang, Junli Wang, Dunjie Lu, Tianbao Xie, Amrita Saha, Doyen Sahoo, Tao Yu, Caiming Xiong

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments ICML 2025

VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Language

Sijin Sun, Liangbin Zhao, Ming Deng, Xiuju Fu

机构 * Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR IHPC)（高性能计算研究所，科技研究局（A*STAR IHPC）） ； National University of Singapore（国立新加坡大学） ； Shanghai University（上海大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments 8 pages, 5 figures, 7 tablels, submitted to ITSC2025

LLM-PySC2: Starcraft II learning environment for Large Language Models

Zongyuan Li, Yanan Ni, Runnan Qi, Lumin Jiang, Chang Lu, Xiaojie Xu, Xiangbei Liu, Pengfei Li, Yunzheng Guo, Zhe Ma, Huanyu Li, Hui Wu, Xian Guo, Kuihua Huang, Xuebo Zhang

机构 * NKAI-Decision-Team（NKAI决策团队） 纠错

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Urban Air Mobility as a System of Systems: An LLM-Enhanced Holonic Approach

Ahmed R. Sadik, Muhammad Ashfaq, Niko Mäkitalo, Tommi Mikkonen

机构 * Honda Research Institute Europe（本田欧洲研究院） ； Faculty of IT University of Jyväskylä（信息技术学院约赫斯基尔亚大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

An LLM-Powered Agent for Physiological Data Analysis: A Case Study on PPG-based Heart Rate Estimation

Mohammad Feli, Iman Azimi, Pasi Liljeberg, Amir M. Rahmani

机构 * Department of Computing, University of Turku（图波卡大学计算机系） ； Department of Computer Science, University of California, Irvine（加州大学伊文斯顿分校计算机科学系） ； School of Nursing, University of California, Irvine（加州大学伊文斯顿分校护理学院） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Sparks: Multi-Agent Artificial Intelligence Model Discovers Protein Design Principles

Alireza Ghafarollahi, Markus J. Buehler

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

On the workflow, opportunities and challenges of developing foundation model in geophysics

Hanlin Sheng, Xinming Wu, Hang Gao, Haibin Di, Sergey Fomel, Jintao Li, Xu Si

机构 * Computational Interpretation Group, Laboratory of Seismology and Physics of the Earth’s Interior, School of Earth and Space Sciences, University of Science and Technology of China（中国科学技术大学地球和空间科学学院地球物理学与地球内部物理实验室） ； SLB ； Bureau of Economic Geology, Jackson School of Geosciences, The University of Texas at Austin（德克萨斯大学奥斯汀分校地质学院经济地质局） ； Georgia Institute of Technology（佐治亚理工学院） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

UFO2: The Desktop AgentOS

Chaoyun Zhang, He Huang, Chiming Ni, Jian Mu, Si Qin, Shilin He, Lu Wang, Fangkai Yang, Pu Zhao, Chao Du, Liqun Li, Yu Kang, Zhao Jiang, Suzhen Zheng, Rujia Wang, Jiaxu Qian, Minghua Ma, Jian-Guang Lou, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

机构 * Microsoft（微软公司） ； ZJU-UIUC Institute（浙大-伊利诺伊大学联合研究所） ； Nanjing University（南京大学） ； Peking University（北京大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments The source code of UFO2 is publicly available at https://github.com/microsoft/UFO/, with comprehensive documentation provided at https://microsoft.github.io/UFO/

Latent Diffusion Planning for Imitation Learning

Amber Xie, Oleh Rybkin, Dorsa Sadigh, Chelsea Finn

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

First-place Solution for Streetscape Shop Sign Recognition Competition

Bin Wang, Li Jing

机构 * Zhejiang Gongshang University（浙江工商大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments technical report

Ascribe New Dimensions to Scientific Data Visualization with VR

Daniela Ushizima, Guilherme Melo dos Santos, Zineb Sordo, Ronald Pandolfi, Jeffrey Donatelli

机构 * Applied Math and Computational Research Division Lawrence Berkeley National Laboratory（应用数学与计算研究部伯克利国家实验室） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

AgentPolyp: Accurate Polyp Segmentation via Image Enhancement Agent

Pu Wang, Zhihua Zhang, Dianjie Lu, Guijuan Zhang, Youshan Zhang, Zhuoran Zheng

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Unlocking the Wisdom of Large Language Models: An Introduction to The Path to Artificial General Intelligence

Edward Y. Chang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 153 pages, 5 figures

UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility

Yonglin Tian, Fei Lin, Yiduo Li, Tengchao Zhang, Qiyao Zhang, Xuan Fu, Jun Huang, Xingyuan Dai, Yutong Wang, Chunwei Tian, Bai Li, Yisheng Lv, Levente Kovács, Fei-Yue Wang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Journal ref Information Fusion, Volume 122, 2025, 103158

Human-like compositional learning of visually-grounded concepts using synthetic environments

Zijun Lin, M Ganesh Kumar, Cheston Tan

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Automated radiotherapy treatment planning guided by GPT-4Vision

Sheng Liu, Oscar Pastor-Serrano, Yizheng Chen, Matthew Gopaulchan, Weixing Liang, Mark Buyyounouski, Erqi Pollom, Quynh-Thu Le, Michael Gensheimer, Peng Dong, Yong Yang, James Zou, Lei Xing

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 12 pages, 4 figures

A Human Digital Twin Architecture for Knowledge-based Interactions and Context-Aware Conversations

Abdul Mannan Mohammed, Azhar Ali Mohammad, Jason A. Ortiz, Carsten Neumann, Grace Bochenek, Dirk Reiners, Carolina Cruz-Neira

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Presented at: 2024 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Paper No. 24366, 10 pages, 5 figures

LeForecast: Enterprise Hybrid Forecast by Time Series Intelligence

Zheng Tan, Yiwen Nie, Wenfa Wu, Guanyu Zhang, Yanze Liu, Xinyuan Tian, Kailin Gao, Mengya Liu, Qijiang Cheng, Haipeng Jiang, Yingzheng Ma, Wei Zheng, Yuci Zhu, Yuanyuan Sun, Xiangyu Lei, Xiyu Guan, Wanqing Huang, Shouming Liu, Xiangquan Meng, Pengzhan Qu, Chao Yang, Jiaxuan Fan, Yuan He, Hongsheng Qi, Yangzhou Du

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

ScreenLLM: Stateful Screen Schema for Efficient Action Understanding and Prediction

Yiqiao Jin, Stefano Petrangeli, Yu Shen, Gang Wu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments Accepted to MM4SG Workshop at The Web Conference 2025

SimBEV: A Synthetic Multi-Task Multi-Sensor Driving Data Generation Tool and Dataset

Goodarz Mehr, Azim Eskandarian

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Driving

Dongkun Zhang, Jiaming Liang, Ke Guo, Sha Lu, Qi Wang, Rong Xiong, Zhenwei Miao, Yue Wang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments CVPR 2025

EmpathyAgent: Can Embodied Agents Conduct Empathetic Actions?

Xinyan Chen, Jiaxin Ge, Hongming Dai, Qiang Zhou, Qiuxuan Feng, Jingtong Hu, Yizhou Wang, Jiaming Liu, Shanghang Zhang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

AlignBot: Aligning VLM-powered Customized Task Planning with User Reminders Through Fine-Tuning for Household Robots

Zhaxizhuoma Zhaxizhuoma, Pengan Chen, Ziniu Wu, Jiawei Sun, Dong Wang, Peng Zhou, Nieqing Cao, Yan Ding, Bin Zhao, Xuelong Li

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Construction

Ganlong Zhao, Guanbin Li, Jia Pan, Yizhou Yu

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Comments Under Submission

TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools

Shanghua Gao, Richard Zhu, Zhenglun Kong, Ayush Noori, Xiaorui Su, Curtis Ginder, Theodoros Tsiligkaridis, Marinka Zitnik

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Project page: https://zitniklab.hms.harvard.edu/TxAgent TxAgent code: https://github.com/mims-harvard/TxAgent ToolUniverse code: https://github.com/mims-harvard/ToolUniverse