arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2821 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2821 篇

2507.01485 2025-07-03 cs.RO cs.AI cs.MA q-bio.QM 57%

BioMARS: A Multi-Agent Robotic System for Autonomous Biological Experiments

Yibo Qiu, Zan Huang, Zhiyu Wang, Handi Liu, Yiling Qiao, Yifeng Hu, Shu'ang Sun, Hangke Peng, Ronald X Xu, Mingzhai Sun

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.11818 2025-07-03 cs.RO cs.AI 57%

Embodied Instruction Following in Unknown Environments

Zhenyu Wu, Ziwei Wang, Xiuwei Xu, Hang Yin, Yinan Liang, Angyuan Ma, Jiwen Lu, Haibin Yan

机构 * School of Intelligent Engineering and Automation, Beijing University of Posts and Telecommunications(北京邮电大学智能工程与自动化学院) School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院) Department of Automation, Tsinghua University(清华大学自动化学院)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments Project Page: https://gary3410.github.io/eif_unknown/

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.00603 2025-07-02 cs.CV 57%

World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model

Yupeng Zheng, Pengxuan Yang, Zebin Xing, Qichao Zhang, Yuhang Zheng, Yinfeng Gao, Pengfei Li, Teng Zhang, Zhongpu Xia, Peng Jia, Dongbin Zhao

机构 * CASIA(中国科学院自动化研究所) Li Auto(力汽车) PCL(鹏城实验室) NUS(新加坡国立大学) Tsinghua(清华大学)

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments ICCV 2025, first version

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.07236 2025-07-01 eess.IV cs.CV 57%

A Narrative Review on Large AI Models in Lung Cancer Screening, Diagnosis, and Treatment Planning

Jiachen Zhong, Yiting Wang, Di Zhu, Ziwei Wang

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments This request is based on the fact that one of the co-authors is a PhD student whose advisor has informed her that she was not authorized to publicly release this work without his prior approval. Unfortunately, this approval was not obtained, and as such, the submission was made without proper institutional and supervisory consent

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.07217 2025-07-01 cs.AI 57%

BIMgent: Towards Autonomous Building Modeling via Computer-use Agents

Zihan Deng, Changyu Du, Stavros Nousias, André Borrmann

机构 * Chair of Computing in Civil and Building Engineering, Technical University of Munich, Germany(土木与建筑工程计算系,慕尼黑技术大学) TUM Georg Nemetschek Institute, Munich, Germany(慕尼黑技术大学Georg Nemetschek研究所)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments ICML 2025 Workshop on Computer Use Agents

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.12993 2025-07-01 cs.IR cs.AI cs.LG q-bio.QM 57%

ChemMiner: A Large Language Model Agent System for Chemical Literature Data Mining

Kexin Chen, Yuyang Du, Junyou Li, Hanqun Cao, Menghao Guo, Xilin Dang, Lanqing Li, Jiezhong Qiu, Pheng Ann Heng, Guangyong Chen

机构 * The Chinese University of Hong Kong, New Territories, Hong Kong SAR(香港中文大学) Zhejiang Lab, Zhejiang University, Hangzhou, China(浙江大学杭州实验室) Hangzhou Institute of Medicine, Chinese Academy of Sciences, Hangzhou, China(中国科学院杭州医学研究所)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.22183 2025-06-30 cs.AI 57%

A Different Approach to AI Safety: Proceedings from the Columbia Convening on Openness in Artificial Intelligence and AI Safety

Camille François, Ludovic Péran, Ayah Bdeir, Nouha Dziri, Will Hawkins, Yacine Jernite, Sayash Kapoor, Juliet Shen, Heidy Khlaaf, Kevin Klyman, Nik Marda, Marie Pellat, Deb Raji, Divya Siddarth, Aviya Skowron, Joseph Spisak, Madhulika Srikumar, Victor Storchan, Audrey Tang, Jen Weedon

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments Proceedings from the Columbia Convening on Openness in Artificial Intelligence and AI Safety

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.21162 2025-06-27 eess.IV cs.AI 57%

A Novel Framework for Integrating 3D Ultrasound into Percutaneous Liver Tumour Ablation

Shuwei Xing, Derek W. Cool, David Tessier, Elvis C. S. Chen, Terry M. Peters, Aaron Fenster

机构 * Robarts Research Institute, Western University, London, Canada(罗巴茨研究所在西蒙大学伦敦分校) School of Biomedical Engineering, Western University, London, Canada(生物医学工程学院,西蒙大学伦敦分校) Department of Medical Biophysics, Western University, London, Canada(医学生物物理学系,西蒙大学伦敦分校) Department of Electrical and Computer Engineering, Western University, London, Canada(电气与计算机工程系,西蒙大学伦敦分校) Department of Medical Imaging, Western University, London, Canada(医学影像系,西蒙大学伦敦分校)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 11 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.11069 2025-06-24 cs.AI cs.HC 57%

API Agents vs. GUI Agents: Divergence and Convergence

Chaoyun Zhang, Shilin He, Liqun Li, Si Qin, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

机构 * Microsoft(微软)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.17378 2025-06-24 cs.RO cs.CV 57%

A workflow for generating synthetic LiDAR datasets in simulation environments

Abhishek Phadke, Shakib Mahmud Dipto, Pratip Rana

机构 * School of Engineering \& Computing Christopher Newport University Department of Computer Science Old Dominion University

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.15425 2025-06-19 cs.CL 57%

Understanding GUI Agent Localization Biases through Logit Sharpness

Xingjian Tao, Yiwei Wang, Yujun Cai, Zhicheng Yang, Jing Tang

机构 * The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)) The Hong Kong University of Science and Technology(香港科学与技术大学) University of California, Merced(加州大学梅德福分校) The University of Queensland(昆士兰大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.12594 2025-06-17 cs.AI cs.MA 57%

A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications

Renjun Xu, Jingwen Peng

机构 * Zhejiang University(浙江大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 95 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.10953 2025-06-13 cs.LG cs.CL 57%

Build the web for agents, not agents for the web

Xing Han Lù, Gaurav Kamath, Marius Mosbach, Siva Reddy

机构 * McGill University(麦吉尔大学) Mila – Quebec AI Institute(蒙特利尔人工智能研究所)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.07803 2025-06-10 cs.CV 57%

Image Reconstruction as a Tool for Feature Analysis

Eduard Allakhverdov, Dmitrii Tarasov, Elizaveta Goncharova, Andrey Kuznetsov

机构 * AIRI Moscow, Russia(莫斯科AIRI机构) MIPT Dolgoprudny, Russia(多尔戈普鲁德尼 MIPT)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 23 pages, 14 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00398 2025-06-03 cs.AI cs.RO 57%

Position: Olfaction Standardization is Essential for the Advancement of Embodied Artificial Intelligence

Kordel K. France, Rohith Peddi, Nik Dennler, Ovidiu Daescu

机构 * Dept. of Computer Science University of Texas at Dallas(计算机科学系德克萨斯大学达拉斯分校) Dept. of Computer Science ETH Zurich(计算机科学系瑞士联邦理工学院苏黎世分校)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00235 2025-06-03 cs.CL 57%

MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility

Yexiao He, Ang Li, Boyi Liu, Zhewei Yao, Yuxiong He

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00071 2025-06-03 q-bio.NC cs.AI cs.RO 57%

Human sensory-musculoskeletal modeling and control of whole-body movements

Chenhui Zuo, Guohao Lin, Chen Zhang, Shanning Zhuang, Yanan Sui

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.24354 2025-06-02 cs.CL 57%

Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research

Qianqian Zhang, Jiajia Liao, Heting Ying, Yibo Ma, Haozhan Shen, Jingcheng Li, Peng Liu, Lu Zhang, Chunxin Fang, Kyusong Lee, Ruochen Xu, Tiancheng Zhao

机构 * Om AI Research(Om AI研究机构) Binjiang Institute of Zhejiang University(浙江大学滨江学院) College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

Comments Accepted by ACL 2025 Demo

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.02673 2025-05-30 cs.LG cs.AI cs.MA 57%

MedRAX: Medical Reasoning Agent for Chest X-ray

Adibvafa Fallahpour, Jun Ma, Alif Munim, Hongwei Lyu, Bo Wang

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 16 pages, 4 figures, 5 Tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.21389 2025-05-28 cs.CL 57%

AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs

Xuanwen Ding, Chengjun Pan, Zejun Li, Jiwen Zhang, Siyuan Wang, Zhongyu Wei

机构 * Fudan University(复旦大学) University of Southern California(南加州大学) Shanghai Innovation Institute(上海创新研究院)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.20814 2025-05-28 cs.RO cs.CV 57%

Spatial RoboGrasp: Generalized Robotic Grasping Control Policy

Yiqi Huang, Travis Davies, Jiahuan Yan, Jiankai Sun, Xiang Chen, Luhui Hu

机构 * Stanford University(斯坦福大学) Peking University(北京大学) ZhiCheng AI(智城AI)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.18010 2025-05-28 cs.RO cs.AI cs.HC 57%

Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation

Zilin Huang, Zihao Sheng, Zhengyang Wan, Yansong Qu, Yuhao Luo, Boyue Wang, Pei Li, Yen-Jung Chen, Jiancong Chen, Keke Long, Jiayi Meng, Yue Leng, Sikai Chen

机构 * Department of Civil and Environmental Engineering, University of Wisconsin-Madison(土木与环境工程系,威斯康星大学麦迪逊分校) Lyles School of Civil and Construction Engineering, Purdue University(莱尔斯土木与建设工程学院,普渡大学) Elmore Family School of Electrical and Computer Engineering, Purdue University(埃尔摩家族电气与计算机工程学院,普渡大学) Department of Computer Science and Engineering, The University of Texas at Arlington(计算机科学与工程系,德克萨斯大学阿灵顿分校) Google(谷歌)

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments 14 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.20273 2025-05-27 cs.AI 57%

Ten Principles of AI Agent Economics

Ke Yang, ChengXiang Zhai

机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.18845 2025-05-27 cs.CL 57%

Multi-Party Conversational Agents: A Survey

Sagar Sapkota, Mohammad Saqib Hasan, Mubarak Shah, Santu Karmaker

机构 * University of Central Florida(中央佛罗里达大学) Stony Brook University(石溪大学)

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.15259 2025-05-27 cs.LG cs.CL 57%

ReGUIDE: Data Efficient GUI Grounding via Spatial Reasoning and Search

Hyunseok Lee, Jeonghoon Kim, Beomjun Kim, Jihoon Tack, Chansong Jo, Jaehong Lee, Cheonbok Park, Sookyo In, Jinwoo Shin, Kang Min Yoo

机构 * KAIST(韩国科学技术院) NAVER Cloud(NAVER云)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.02279 2025-05-26 cs.AI 57%

A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)

Abul Ehtesham, Aditi Singh, Gaurav Kumar Gupta, Saket Kumar

机构 * Kent State University(肯特州立大学) Cleveland State University(克利夫兰州立大学) Youngstown State University(青年州立大学) Northeastern University(东北大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.16640 2025-05-23 cs.CR cs.AI 57%

BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization

Xueyang Zhou, Guiyao Tie, Guowen Zhang, Hechang Wang, Pan Zhou, Lichao Sun

机构 * Huazhong University of Science and Technology(华中科技大学) Lehigh University(莱斯大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 19 pages, 12 figures, 6 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.16282 2025-05-23 cs.CV 57%

ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replay

Fanbin Lu, Zhisheng Zhong, Shu Liu, Chi-Wing Fu, Jiaya Jia

机构 * The Chinese University of Hong Kong(香港中文大学) SmartMore Hong Kong University of Science and Technology(香港理工大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.11871 2025-05-22 cs.HC cs.AI 57%

TinyClick: Single-Turn Agent for Empowering GUI Automation

Pawel Pawlowski, Krystian Zawistowski, Wojciech Lapacz, Adam Wiacek, Marcin Skorupa, Sebastien Postansque, Jakub Hoscilowicz

机构 * Warsaw University of Technology(华沙技术大学)

专题命中 多模态Agent :MLLM(abstract);分类 cs.AI

Comments Accepted to Interspeech 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.17140 2025-05-20 cs.AI 57%

AXIS: Efficient Human-Agent-Computer Interaction with API-First LLM-Based Agents

Junting Lu, Zhiyang Zhang, Fangkai Yang, Jue Zhang, Lu Wang, Chao Du, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

机构 * Peking University(北京大学) Nanjing University(南京大学) Microsoft(微软)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏