arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2821 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2821 篇

2507.15782 2025-07-22 cs.RO 50%

Interleaved LLM and Motion Planning for Generalized Multi-Object Collection in Large Scene Graphs

Ruochu Yang, Yu Zhou, Fumin Zhang, Mengxue Hou

机构 * School of Electrical and Computer Engineering, Georgia Institute of Technology(佐治亚理工学院电气与计算机工程学院) School of Electrical Engineering, Notre Dame University(诺特难大学电气工程学院) Department of Electrical and Computer Engineering, Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technology(香港科学与技术大学电气与计算机工程系、机械与航空航天工程系)

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.18347 2025-07-22 cs.RO 50%

The Constitutional Filter: Bayesian Estimation of Compliant Agents

Simon Kohaut, Felix Divo, Benedict Flade, Devendra Singh Dhami, Julian Eggert, Kristian Kersting

机构 * Artificial Intelligence and Machine Learning Group, Department of Computer Science, TU Darmstadt(德累斯顿技术大学计算机科学系人工智能与机器学习小组) Honda Research Institute Europe GmbH(本田欧洲研究院) Uncertainty in Artificial Intelligence Group, Department of Mathematics and Computer Science, TU Eindhoven(埃因霍温技术大学数学与计算机科学系人工智能不确定性小组) German Center for Artificial Intelligence (DFKI)(德国人工智能中心(DFKI))

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.03799 2025-07-21 eess.SY cs.SY 50%

Recursively Feasible Chance-constrained Model Predictive Control under Gaussian Mixture Model Uncertainty

Kai Ren, Colin Chen, Hyeontae Sung, Heejin Ahn, Ian Mitchell, Maryam Kamgarpour

专题命中 多模态Agent :multi-modal(abstract)

Comments Published in IEEE Transactions on Control Systems Technology SI: Intelligent Decision Making, Planning and Control of Automated Vehicles

Journal ref in IEEE Transactions on Control Systems Technology, vol. 33, no. 4, pp. 1193-1206, July 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.13200 2025-07-18 cs.RO 50%

Few-shot transfer of tool-use skills using human demonstrations with proximity and tactile sensing

Marina Y. Aoyama, Sethu Vijayakumar, Tetsuya Narita

机构 * School of Informatics, The University of Edinburgh, U.K.(信息学院,爱丁堡大学,英国) Sony Group Corporation, Japan(索尼集团,日本)

专题命中 多模态Agent :multimodal(abstract)

Comments 8 pages, 9 figures, IEEE Robotics and Automation Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.12977 2025-07-18 cs.RO 50%

Non-differentiable Reward Optimization for Diffusion-based Autonomous Motion Planning

Giwon Lee, Daehee Park, Jaewoo Jeong, Kuk-Jin Yoon

机构 * Department of Mechanical Engineering, KAIST(韩国科学技术院机械工程系) Department of Electrical Engineering and Computer Science, DGIST(韩国科学技术院电子工程与计算机科学系)

专题命中 多模态Agent :multi-modal(abstract)

Comments Accepted at IROS 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.09367 2025-07-16 cs.MA 50%

Simulation for All: A Step-by-Step Cookbook for Developing Human-Centered Multi-Agent Transportation Simulators

Shiva Azimi, Arash Tavakoli

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.11160 2025-07-16 stat.ME 50%

Efficient Canonical Correlation Analysis with Sparsity

Zixuan Wu, Elena Tuzhilina, Claire Donnat

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.10539 2025-07-15 cs.LG 50%

Graph World Model

Tao Feng, Yexin Wu, Guanyu Lin, Jiaxuan You

机构 * Department of Computer Science, University of Illinois Urbana Champaign Urbana, IL, USA(计算机科学系,伊利诺伊大学厄巴纳-香槟分校)

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.05114 2025-07-08 stat.ME cs.NA math.NA math.ST stat.TH 50%

Sequential multiple importance sampling for high-dimensional Bayesian inference

Li Binbin, He Xiao, Liao Zihan

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.04430 2025-07-08 cs.RO 50%

"Hi AirStar, Guide Me to the Badminton Court."

Ziqin Wang, Jinyu Chen, Xiangyi Zheng, Qinan Liao, Linjiang Huang, Si Liu

机构 * Beihang University(北京航空航天大学)

专题命中 多模态Agent :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.21631 2025-06-30 cs.RO 50%

Real-Time 3D Guidewire Reconstruction from Intraoperative DSA Images for Robot-Assisted Endovascular Interventions

Tianliang Yao, Bingrui Li, Bo Lu, Zhiqiang Pei, Yixuan Yuan, Peng Qi

机构 * Department of Control Science and Engineering, College of Electronic and Information Engineering, and Shanghai Institute of Intelligent Science and Technology, Tongji University(控制科学与工程系,电子与信息工程学院,智能科学与技术上海研究院,同济大学) Department of Electronic Engineering, Faculty of Engineering, The Chinese University of Hong Kong(电子工程系,工程学院,香港中文大学) Department of Artificial Intelligence and Computer Science, School of Computer Science, University of Birmingham(人工智能与计算机科学系,计算机科学学院,伯明翰大学) Robotics and Microsystems Center, School of Mechanical and Electric Engineering, Soochow University(机器人与微系统中心,机械与电子工程学院,苏州大学) School of Oriental Pan-Vascular Devices Innovation College, University of Shanghai for Science and Technology(东方血管器件创新学院,上海科学技术大学) State Key Laboratory of Cardiovascular Diseases and Medical Innovation Center, Shanghai East Hospital, School of Medicine, Tongji University(心血管疾病国家重点实验室,医疗创新中心,上海东方医院,同济大学医学院)

专题命中 多模态Agent :multimodal(abstract)

Comments This paper has been accepted by IEEE/RSJ IROS 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.09424 2025-06-27 cs.HC 50%

Feel the Breeze: Promoting Relaxation in Virtual Reality using Mid-Air Haptics

Naga Sai Surya Vamsy Malladi, Viktorija Paneva, Jörg Müller

专题命中 多模态Agent :multimodal(abstract)

Comments 5 pages, 6 figures. This is the author's version. Final version of records is to appear in 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.16542 2025-06-24 cs.HC 50%

Virtual Interviewers, Real Results: Exploring AI-Driven Mock Technical Interviews on Student Readiness and Confidence

Nathalia Gomez, S. Sue Batham, Matias Volonte, Tiffany D. Do

专题命中 多模态Agent :multimodal(abstract)

Comments 6 pages, To Appear in Companion Publication of the 2025 Conference on Computer-Supported Cooperative Work and Social Computing (CSCW Companion '25)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.16555 2025-06-23 cs.RO cs.SY eess.SY 50%

An Optimization-Augmented Control Framework for Single and Coordinated Multi-Arm Robotic Manipulation

Melih Özcan, Ozgur S. Oguz

机构 * Department of Electrical and Electronics Engineering, Middle East Technical University(电子与电气工程系,中东部技术大学) Department of Computer Engineering, Bilkent University(计算机工程系,比尔肯特大学)

专题命中 多模态Agent :multi-modal(abstract)

Comments 8 pages, 8 figures, accepted for oral presentation at IROS 2025. Supplementary site: https://sites.google.com/view/komo-force/home

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.13068 2025-06-18 cs.MA 50%

Towards the Autonomous Optimization of Urban Logistics: Training Generative AI with Scientific Tools via Agentic Digital Twins and Model Context Protocol

Haowen Xu, Yulin Sun, Jose Tupayachi, Olufemi Omitaomu, Sisi Zlatanova, Xueping Li

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.12544 2025-06-17 eess.SY cs.RO cs.SY 50%

Constrained Diffusers for Safe Planning and Control

Jichen Zhang, Liqun Zhao, Antonis Papachristodoulou, Jack Umenberger

机构 * University of Oxford(牛津大学)

专题命中 多模态Agent :multimodal(abstract)

Comments 12 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.11852 2025-06-16 eess.IV 50%

3D Skin Segmentation Methods in Medical Imaging: A Comparison

Martina Paccini, Giuseppe Patanè

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.10462 2025-06-13 cs.RO 50%

Are We Generalizing from the Exception? An In-the-Wild Study on Group-Sensitive Conversation Design in Human-Agent Interactions

Ana Müller, Sabina Jeschke, Anja Richert

机构 * Cologne Cobots Lab, TH Köln - University of Applied Sciences(科隆机器人实验室,TH Köln应用科学大学) KI Park e.V. & FAU - Friedrich-Alexander University of Erlangen-Nuremberg(KI Park协会与弗赖堡-艾森纳赫大学)

专题命中 多模态Agent :multimodal(abstract)

Comments Accepted as a regular paper at the 2025 IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). \c{opyright} IEEE. This is the preprint version. The final version will appear in the IEEE proceedings

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.03682 2025-06-13 cs.CR cs.HC 50%

Towards Scalable Defenses against Intimate Partner Infiltrations

Weisi Yang, Shinan Liu, Feng Xiao, Nick Feamster, Stephen Xia

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.09623 2025-06-12 cs.RO 50%

Analytic Task Scheduler: Recursive Least Squares Based Method for Continual Learning in Embodied Foundation Models

Lipei Xie, Yingxin Li, Huiping Zhuang

机构 * Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 510641, P. R. China(华南理工大学智能工程学院)

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.08296 2025-06-12 cs.RO 50%

HiBerNAC: Hierarchical Brain-emulated Robotic Neural Agent Collective for Disentangling Complex Manipulation

Hongjun Wu, Heng Zhang, Pengsong Zhang, Jin Wang, Cong Wang

机构 * Johns Hopkins University(约翰霍普金斯大学) Italian Institute of Technology(意大利理工学院) University of Toronto(多伦多大学) Massachusetts General Hospital, Harvard University(哈佛大学麻省总医院)

专题命中 多模态Agent :multimodal(abstract)

Comments 31 pages,5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.09739 2025-06-12 cs.RO 50%

Trailblazer: Learning offroad costmaps for long range planning

Kasi Viswanath, Felix Sanchez, Timothy Overbye, Jason M. Gregory, Srikanth Saripalli

机构 * DEVCOM Army Research laboratory(陆军研究实验室)

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.11654 2025-06-11 math.LO 50%

A logical perspective on intending to keep a true secret

Alessandro Aldini, Davide Fazio, Pierluigi Graziani, Raffaele Mascella, Mirko Tagliaferri

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.07509 2025-06-10 cs.RO 50%

Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent

Shoon Kit Lim, Melissa Jia Ying Chong, Jing Huey Khor, Ting Yang Ling

机构 * University of Southampton Malaysia(英国南安普顿大学马来西亚分校) Connected Intelligence Research Group(连接智能研究组) Sustainable Electronic Technologies(可持续电子技术)

专题命中 多模态Agent :multimodal(abstract)

Comments Source code available at: https://github.com/limshoonkit/ros2-agent-ws

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.06973 2025-06-10 nlin.CD 50%

The symbolic partition with generalized Koopman analysis

Haipeng Li, Pengfei Guo, Yueheng Lan

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.05648 2025-06-09 cs.HC cs.RO 50%

A Modular Haptic Display with Reconfigurable Signals for Personalized Information Transfer

Antonio Alvarez Valdivia, Benjamin A. Christie, Dylan P. Losey, Laura H. Blumenschein

机构 * Purdue University(普渡大学) Virginia Tech(弗吉尼亚理工学院)

专题命中 多模态Agent :multimodal(abstract)

Comments This work has been submitted to the IEEE Transactions on Haptics for possible publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.03673 2025-06-09 cs.RO 50%

RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaboration

Huajie Tan, Xiaoshuai Hao, Cheng Chi, Minglan Lin, Yaoxu Lyu, Mingyu Cao, Dong Liang, Zhuo Chen, Mengsi Lyu, Cheng Peng, Chenrui He, Yulong Ao, Yonghua Lin, Pengwei Wang, Zhongyuan Wang, Shanghang Zhang

机构 * State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机学院,北京大学) Beijing Academy of Artificial Intelligence (BAAI)(北京人工智能研究院)

专题命中 多模态Agent :MLLM(abstract)

Comments 22 pages, 10 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.23196 2025-05-30 stat.ML cs.LG 50%

JAPAN: Joint Adaptive Prediction Areas with Normalising-Flows

Eshant English, Christoph Lippert

机构 * Hasso Plattner Institute for Digital Engineering(霍普斯·普兰特研究所数字工程院) University of Tokyo(东京大学) Hasso Plattner Institute for Digital Health at the Icahn School of Medicine at Mount Sinai(霍普斯·普兰特研究所数字健康院)

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.04672 2025-05-27 cs.LG cs.MA cs.NI eess.SP 50%

Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement Learning

Wenjun Zhang, Qiong Wu, Pingyi Fan, Kezhi Wang, Nan Cheng, Wen Chen, Khaled B. Letaief

机构 * School of Internet of Things Engineering, Jiangnan University(江南大学物联网工程学院) Department of Electronic Engineering, State Key Laboratory of Space Network and Communications, and the Beijing National Research Center for Information Science and Technology, Tsinghua University(清华大学电子工程系、空间网络与通信国家重点实验室及北京信息科学与技术国家研究中心) Department of Computer Science, Brunel University(布鲁内尔大学计算机科学系) State Key Laboratory of ISN and the School of Telecommunications Engineering, Xidian University(西安电子科技大学信息与通信系统国家重点实验室及电信工程学院) Department of Electronic Engineering, Shanghai Jiao Tong University(上海交通大学电子工程系) Department of Electrical and Computer Engineering, the Hong Kong University of Science and Technology(香港科技大学电子与计算机工程系)

专题命中 多模态Agent :multi-modal(abstract)

Comments This paper has been submitted to IEEE Journal. The source code has been released at:https://github.com/qiongwu86/Semantic-Aware-Resource-Management-for-C-V2X-Platooning-via-Multi-Agent-Reinforcement-Learning

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.15010 2025-05-22 cs.RO 50%

Shape-Adaptive Planning and Control for a Deformable Quadrotor

Yuze Wu, Zhichao Han, Xuankang Wu, Yuan Zhou, Junjie Wang, Zheng Fang, Fei Gao

机构 * State Key Laboratory of Industrial Control Technology, Zhejiang University(浙江大学工业控制技术状态重点实验室) Huzhou Institute, Zhejiang University(浙江大学湖州市院) Faculty of Robot Science and Engineering, Northeastern University(东北大学机器人科学与工程学院)

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏