多模态大模型

A "Wenlu" Brain System for Multimodal Cognition and Embodied Decision-Making: A Secure New Architecture for Deep Integration of Foundation Models and Domain Knowledge

Liang Geng

机构 * College of Mechanical and Electrical Engineering, Shijiazhuang University（石家庄大学机械与电气工程学院） ； School of Artificial Intelligence, Beijing University of Posts and Telecommunications（北京邮电大学人工智能学院） ； The Key Laboratory of Agricultural Robotics Intelligent Perception in Shijiazhuang（石家庄农业机器人智能感知重点实验室） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Exploring Multi-Modal Data with Tool-Augmented LLM Agents for Precise Causal Discovery

ChengAo Shen, Zhengzhang Chen, Dongsheng Luo, Dongkuan Xu, Haifeng Chen, Jingchao Ni

机构 * University of Houston（德克萨斯大学休斯顿分校） ； NEC Laboratories America（NEC美国实验室） ； Florida International University（佛罗里达国际大学） ； North Carolina State University（北卡罗来纳州立大学） 纠错

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answering

Yuren Mao, Wenyi Xu, Yuyang Qin, Yunjun Gao

机构 * School of Software Technology, Zhejiang University（浙江大学软件学院） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

LLM Context Conditioning and PWP Prompting for Multimodal Validation of Chemical Formulas

Evgeny Markhasin

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 10 pages

TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakes

Chao Zhang, Shaolei Zhang, Quehuan Liu, Sibei Chen, Tong Li, Ju Fan

机构 * Renmin University of China（中国人民大学） 纠错

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

OSUniverse: Benchmark for Multimodal GUI-navigation AI Agents

Mariya Davydova, Daniel Jeffries, Patrick Barker, Arturo Márquez Flores, Sinéad Ryan

机构 * Kentauros AI Inc.（Kentauros AI公司） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Optimizing SIA Development: A Case Study in User-Centered Design for Estuary, a Multimodal Socially Interactive Agent Framework

Spencer Lin, Miru Jun, Basem Rizk, Karen Shieh, Scott Fisher, Sharon Mozgai

机构 * University of Southern California（南加州大学） ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Beyond Text: Implementing Multimodal Large Language Model-Powered Multi-Agent Systems Using a No-Code Platform

Cheonsu Jeong

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 22 pages, 27 figures

Journal ref 2025 Journal of Intelligence and Information Systems

Multi-modal Knowledge Distillation-based Human Trajectory Forecasting

Jaewoo Jeong, Seohee Lee, Daehee Park, Giwon Lee, Kuk-Jin Yoon

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to CVPR 2025

MMAC-Copilot: Multi-modal Agent Collaboration Operating Copilot

Zirui Song, Yaohang Li, Meng Fang, Yanda Li, Zhenhao Chen, Zecheng Shi, Yuan Huang, Xiuying Chen, Ling Chen

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Comments Technical Reports

Towards Agentic Recommender Systems in the Era of Multimodal Large Language Models

Chengkai Huang, Junda Wu, Yu Xia, Zixu Yu, Ruhan Wang, Tong Yu, Ruiyi Zhang, Ryan A. Rossi, Branislav Kveton, Dongruo Zhou, Julian McAuley, Lina Yao

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

LEMMo-Plan: LLM-Enhanced Learning from Multi-Modal Demonstration for Planning Sequential Contact-Rich Manipulation Tasks

Kejia Chen, Zheng Shen, Yue Zhang, Lingyun Chen, Fan Wu, Zhenshan Bing, Sami Haddadin, Alois Knoll

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecasting

Bohan Tang, Yiqi Zhong, Chenxin Xu, Wei-Tao Wu, Ulrich Neumann, Yanfeng Wang, Ya Zhang, Siheng Chen

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2110.13947

Evidential Uncertainty Estimation for Multi-Modal Trajectory Prediction

Sajad Marvi, Christoph Rist, Julian Schmidt, Julian Jordan, Abhinav Valada

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Urban Safety Perception Through the Lens of Large Multimodal Models: A Persona-based Approach

Ciro Beneduce, Bruno Lepri, Massimiliano Luca

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Solar Multimodal Transformer: Intraday Solar Irradiance Predictor using Public Cameras and Time Series

Yanan Niu, Roy Sarkis, Demetri Psaltis, Mario Paolone, Christophe Moser, Luisa Lambertini

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Comments WACV2025

ChatMotion: A Multimodal Multi-Agent for Human Motion Analysis

Lei Li, Sen Jia, Jianhao Wang, Zhaochong An, Jiaang Li, Jenq-Neng Hwang, Serge Belongie

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Coherence-Driven Multimodal Safety Dialogue with Active Learning for Embodied Agents

Sabit Hassan, Hye-Young Chung, Xiang Zhi Tan, Malihe Alikhani

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments To appear at AAMAS, 2025

Exploring Embodied Multimodal Large Models: Development, Datasets, and Future Directions

Shoubin Chen, Zehao Wu, Kai Zhang, Chunyu Li, Baiyang Zhang, Fei Ma, Fei Richard Yu, Qingquan Li

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 81 pages, submitted to a journal for review

Explainable Multimodal Machine Learning for Revealing Structure-Property Relationships in Carbon Nanotube Fibers

Daisuke Kimura, Naoko Tajima, Toshiya Okazaki, Shun Muroga

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 33 pages, 9 figures

DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers

Yuntao Chen, Yuqi Wang, Zhaoxiang Zhang

专题命中 多模态Agent ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Precision ICU Resource Planning: A Multimodal Model for Brain Surgery Outcomes

Maximilian Fischer, Florian M. Hauptmann, Robin Peretzke, Paul Naser, Peter Neher, Jan-Oliver Neumann, Klaus Maier-Hein

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

PsyDraw: A Multi-Agent Multimodal System for Mental Health Screening in Left-Behind Children

Yiqun Zhang, Xiaocui Yang, Xiaobai Li, Siyuan Yu, Yi Luan, Shi Feng, Daling Wang, Yifei Zhang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments preprint

LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation

Yijun Liu, Wu Liu, Xiaoyan Gu, Yong Rui, Xiaodong He, Yongdong Zhang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Self-supervised cost of transport estimation for multimodal path planning

Vincent Gherold, Ioannis Mandralis, Eric Sihite, Adarsh Salagame, Alireza Ramezani, Morteza Gharib

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

MobileFlow: A Multimodal LLM For Mobile GUI Agent

Songqin Nong, Jiali Zhu, Rui Wu, Jiongchao Jin, Shuo Shan, Xiutian Huang, Wenhao Xu

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Large Language Model-empowered multimodal strain sensory system for shape recognition, monitoring, and human interaction of tensegrity

Zebing Mao, Ryota Kobayashi, Hiroyuki Nabae, Koichi Suzumori

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Multimodal Perception System for Real Open Environment

Yuyang Sha

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction

Yonggang Jin, Ge Zhang, Hao Zhao, Tianyu Zheng, Jarvi Guo, Liuyu Xiang, Shawn Yue, Stephen W. Huang, Zhaofeng He, Jie Fu

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Digitizing Touch with an Artificial Multimodal Fingertip

Mike Lambeta, Tingfan Wu, Ali Sengul, Victoria Rose Most, Nolan Black, Kevin Sawyer, Romeo Mercado, Haozhi Qi, Alexander Sohn, Byron Taylor, Norb Tydingco, Gregg Kammerer, Dave Stroud, Jake Khatha, Kurt Jenkins, Kyle Most, Neal Stein, Ricardo Chavira, Thomas Craven-Bartle, Eric Sanchez, Yitian Ding, Jitendra Malik, Roberto Calandra

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments 28 pages