arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4892 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4892 篇

2401.10566 2025-06-30 cs.LG stat.ML 78%

ROME: Robust Multi-Modal Density Estimator

Anna Mészáros, Julian F. Schumann, Javier Alonso-Mora, Arkady Zgonnikov, Jens Kober

机构 * Cognitive Robotics, TU Delft, Netherlands(认知机器人学,代尔夫特理工大学,荷兰)

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.19201 2025-06-25 cs.RO 78%

The MOTIF Hand: A Robotic Hand for Multimodal Observations with Thermal, Inertial, and Force Sensors

Hanyang Zhou, Haozhe Lou, Wenhao Liu, Enyu Zhao, Yue Wang, Daniel Seita

机构 * Department of Computer Science, Viterbi School of Engineering University of Southern California(计算机科学系,维特比工程学院,南加州大学)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.02796 2025-06-25 math.NT math.CO 78%

Multimodal sequences and their generating functions

Philip Cuthbertson, Robert Schneider

专题命中 其他多模态 :multimodal(title,abstract)

Comments 13 pages, submitted for publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.20691 2025-06-24 cs.NI cs.LG eess.SP 78%

Wireless-Friendly Window Position Optimization for RIS-Aided Outdoor-to-Indoor Networks based on Multi-Modal Large Language Model

Jinbo Hou, Kehai Qiu, Zitian Zhang, Yong Yu, Kezhi Wang, Stefano Capolongo, Jiliang Zhang, Zeyang Li, Jie Zhang

机构 * Department of Electronic and Electrical Engineering, the University of Sheffield(电子与电气工程系,谢菲尔德大学) Department of Computer Science and Technology, University of Cambridge(计算机科学与技术系,剑桥大学) Brunel University London(伦敦布鲁内尔大学) School of Information and Electronic Engineering, Zhejiang Gongshang University(信息与电子工程学院,浙江工商大学) Design & Health Lab, Department of Architecture, Built Environment and Construction Engineering, Politecnico di Milano(设计与健康实验室,建筑、环境与土木工程系,米兰理工学院) Department of Computer Science, Brunel University London(计算机科学系,伦敦布鲁内尔大学) The State Key Laboratory of Synthetical Automation for Process Industries and The College of Information Science and Engineering, Northeastern University(过程工业综合自动化国家重点实验室和信息科学与工程学院,东北大学) Centre for Wireless Innovation, Queen’s University of Belfast(无线创新中心,贝尔法斯特女王大学)

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.13150 2025-06-23 physics.med-ph 78%

Multimodal Imaging-based Material Mass Density Estimation for Proton Therapy Using Physics-Constrained Deep Learning

Chih-Wei Chang, Raanan Marants, Yuan Gao, Matthew Goette, Jessica E. Scholey, Jeffrey D. Bradley, Tian Liu, Jun Zhou, Atchar Sudhyadhom, Xiaofeng Yang

专题命中 其他多模态 :multimodal(title,abstract)

Journal ref British Journal of Radiology, Volume 96, Issue 1152, 1 December 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.15450 2025-06-19 cs.RO 78%

SurfAAV: Design and Implementation of a Novel Multimodal Surfing Aquatic-Aerial Vehicle

Kun Liu, Junhao Xiao, Hao Lin, Yue Cao, Hui Peng, Kaihong Huang, Huimin Lu

机构 * College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China(智能科学与技术学院,国防科技大学,长沙,中国) School of Electronic Information, Central South University, Changsha, China(电子信息学院,中南大学,长沙,中国)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.00805 2025-06-19 cs.RO 78%

Tailless Flapping-Wing Robot With Bio-Inspired Elastic Passive Legs for Multi-Modal Locomotion

Zhi Zheng, Xiangyu Xu, Jin Wang, Yikai Chen, Jingyang Huang, Ruixin Wu, Huan Yu, Guodong Lu

机构 * State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University(流体动力与机械系统国家重点实验室,机械工程学院,浙江大学) Zhejiang Key Laboratory of Industrial Big Data and Robot Intelligent Systems, Zhejiang University(工业大数据与机器人智能系统浙江省重点实验室,浙江大学) Robotics Research Center of Yuyao City(余姚市机器人研究室) College of Electrical Engineering, Zhejiang University(电气工程学院,浙江大学) College of Control Science and Engineering, Zhejiang University(控制科学与工程学院,浙江大学)

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 8 pages, 11 figures, accepted by IEEE Robotics and Automation Letters (RAL)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.12368 2025-06-17 cs.IT eess.SP math.IT 78%

Stacked Intelligent Metasurfaces for Multi-Modal Semantic Communications

Guojun Huang, Jiancheng An, Lu Gan, Dusit Niyato, Mérouane Debbah, Tie Jun Cui

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 6 pages, 6 figures, have been accepted by IEEE WCL

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.03847 2025-06-17 q-bio.QM cs.LG q-bio.BM 78%

Interpretable Multimodal Learning for Tumor Protein-Metal Binding: Progress, Challenges, and Perspectives

Xiaokun Liu, Sayedmohammadreza Rastegari, Yijun Huang, Sxe Chang Cheong, Weikang Liu, Wenjie Zhao, Qihao Tian, Hongming Wang, Yingjie Guo, Shuo Zhou, Sina Tabakhi, Xianyuan Liu, Zheqing Zhu, Wei Sang, Haiping Lu

机构 * Institute of Big Data Science and Industry, Shanxi University, Taiyuan, China(山西大学大数据科学与产业研究院) School of Computer and Information Technology, Shanxi University, Taiyuan, China(山西大学计算机与信息学院) Key Laboratory of Evolutionary Science Intelligence of Shanxi Province, Taiyuan, Shanxi, China(山西省进化科学智能重点实验室) Faculty of Computer Engineering, University of Isfahan, Isfahan, Iran(伊斯法罕大学计算机工程学院) The First Clinical Medical School, Shanxi Medical University, Taiyuan, China(山西医科大学第一临床医学院) School of Medicine & Population Health, University of Sheffield, Sheffield, UK(谢菲尔德大学医学院与人口健康学院) School of Computer Science, University of Sheffield, Sheffield, UK(谢菲尔德大学计算机科学学院) Centre for Machine Intelligence, University of Sheffield, Sheffield, UK(谢菲尔德大学智能中心)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.21190 2025-06-17 cs.LG 78%

Geodesic Slice Sampler for Multimodal Distributions with Strong Curvature

Bernardo Williams, Hanlin Yu, Hoang Phuc Hau Luu, Georgios Arvanitidis, Arto Klami

机构 * Department of Computer Science, University of Helsinki, Finland(赫尔辛基大学计算机科学系) Cognitive Systems, DTU Compute, Technical University of Denmark(丹麦技术大学计算系认知系统)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.09467 2025-06-12 cs.DB 78%

ArcNeural: A Multi-Modal Database for the Gen-AI Era

Wu Min, Qiao Yuncong, Yu Tan, Chenghu Yang

专题命中 其他多模态 :multi-modal(title);multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.03486 2025-06-12 cs.RO 78%

STREAMS: An Assistive Multimodal AI Framework for Empowering Biosignal Based Robotic Controls

Ali Rabiee, Sima Ghafoori, Xiangyu Bai, Sarah Ostadabbas, Reza Abiri

机构 * Dept. of Electrical Engineering University of Rhode Island Kingston, RI, USA(电气工程系 罗德岛大学 罗得岛州金斯顿) Computer Engineering Northeastern University Boston, Massachusetts, USA(计算机工程 美国东北大学 波士顿)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.06476 2025-06-10 cs.RO 78%

Enhancing Situational Awareness in Underwater Robotics with Multi-modal Spatial Perception

Pushyami Kaveti, Ambjorn Grimsrud Waldum, Hanumant Singh, Martin Ludvigsen

机构 * Northeastern University(东北大学) NTNU(挪威特罗姆瑟大学)

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.02664 2025-06-04 stat.ML cond-mat.dis-nn cs.LG 78%

Computational Thresholds in Multi-Modal Learning via the Spiked Matrix-Tensor Model

Hugo Tabanelli, Pierre Mergny, Lenka Zdeborova, Florent Krzakala

机构 * Information Learning and Physics Laboratory, École Polytechnique Fédérale de Lausanne (EPFL)(信息学习与物理实验室,瑞士联邦理工学院(EPFL)) Statistical Physics of Computation Laboratory, École Polytechnique Fédérale de Lausanne (EPFL)(计算统计物理实验室,瑞士联邦理工学院(EPFL))

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.16512 2025-06-03 cs.HC cs.RO 78%

Multimodal Sensing and Machine Learning to Compare Printed and Verbal Assembly Instructions Delivered by a Social Robot

Ruchik Mishra, Laksita Prasanna, Adair Adair, Dan O Popa

机构 * Louisville Automation and Robotics Research Institute (LARRI), University of Louisville(路易斯维尔自动化与机器人研究研究所(LARRI)、路易斯维尔大学)

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted to IEEE CASE 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.08499 2025-06-03 physics.med-ph 78%

Scattering polarimetry enables correlative nerve fiber imaging and multimodal analysis

Franca auf der Heiden, Markus Axer, Katrin Amunts, Miriam Menzel

专题命中 其他多模态 :multimodal(title,abstract)

Comments 28 pages, 7 figures, all study data are available on https://doi.org/10.26165/JUELICH-DATA/CUXQYF

Journal ref Sci Rep 15, 18493 (2025)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.22447 2025-05-29 cs.CR 78%

Privacy-preserving Prompt Personalization in Federated Learning for Multimodal Large Language Models

Sizai Hou, Songze Li, Baturalp Buyukates

专题命中 其他多模态 :multimodal(title,abstract)

Comments Under Review

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.20547 2025-05-28 stat.ML cs.LG stat.CO 78%

Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributions

Dongze Wu, Yao Xie

机构 * Dongze Wu Yao Xie

专题命中 其他多模态 :multi-modal(title,abstract)

Comments This paper has been accepted to ICML 2025 and will appear in the Proceedings of Machine Learning Research (PMLR)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.16665 2025-05-23 cs.IR 78%

MDVT: Enhancing Multimodal Recommendation with Model-Agnostic Multimodal-Driven Virtual Triplets

Jinfeng Xu, Zheyu Chen, Jinze Li, Shuo Yang, Hewei Wang, Yijie Li, Mengran Li, Puzhen Wu, Edith C. H. Ngai

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by KDD 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.16138 2025-05-23 cs.LG cs.DC 78%

Multimodal Online Federated Learning with Modality Missing in Internet of Things

Heqiang Wang, Xiang Liu, Xiaoxiong Zhong, Lixing Chen, Fangming Liu, Weizhe Zhang

机构 * Peng Cheng Laboratory(鹏城实验室) Shanghai Jiao Tong University(上海交通大学)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.11366 2025-05-19 cs.RO cs.HC cs.LG cs.SY eess.SY 78%

Learning Multimodal AI Algorithms for Amplifying Limited User Input into High-dimensional Control Space

Ali Rabiee, Sima Ghafoori, MH Farhadi, Robert Beyer, Xiangyu Bai, David J Lin, Sarah Ostadabbas, Reza Abiri

机构 * Department of Electrical, Computer, and Biomedical Engineering, University of Rhode Island(电气、计算机与生物医学工程系,罗德岛大学) Department of Electrical and Computer Engineering, Northeastern University(电气与计算机工程系,东北大学) Department of Neurology, Harvard Medical School(神经病学系,哈佛医学院)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.10782 2025-05-19 cs.AR 78%

EdgeMM: Multi-Core CPU with Heterogeneous AI-Extension and Activation-aware Weight Pruning for Multimodal LLMs at Edge

Kangbo Bai, Le Ye, Ru Huang, Tianyu Jia

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by DAC 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.10015 2025-05-16 eess.SP 78%

Constrained Multimodal Sensing-Aided Communications: A Dynamic Beamforming Design

Abolfazl Zakeri, Nhan Thanh Nguyen, Ahmed Alkhateeb, Markku Juntti

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.09536 2025-05-15 physics.app-ph 78%

Multimodal transformers with elemental priors for phase classification of X-ray diffraction spectra

Kangyu Ji, Fang Sheng, Tianran Liu, Basita Das, Tonio Buonassisi

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.07340 2025-05-13 cs.HC 78%

Thalamus: A User Simulation Toolkit for Prototyping Multimodal Sensing Studies

Kayhan Latifzadeh, Luis A. Leiva

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.06640 2025-05-13 q-bio.NC 78%

NeuroPal: A Clinically-Informed Multimodal LLM Assistant for Mental Health Combining Sleep Chronotherapy, Cognitive Behavioral Reframing, and Adaptive Phytochemical Intervention

Xiaoran Han

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.14706 2025-05-13 eess.SY cs.SY q-bio.BM 78%

Controlling Peak Sharpness in Multimodal Biomolecular Systems via the Chemical Fokker-Planck Equation

Taishi Kotsuka, Enoch Yeung

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.03704 2025-05-08 stat.ML cs.LG 78%

Multi-modal cascade feature transfer for polymer property prediction

Kiichi Obuchi, Yuta Yahagi, Kiyohiko Toyama, Shukichi Tanaka, Kota Matsui

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.01134 2025-05-05 cs.LG 78%

Aggregation of Dependent Expert Distributions in Multimodal Variational Autoencoders

Rogelio A Mancisidor, Robert Jenssen, Shujian Yu, Michael Kampffmeyer

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.21393 2025-05-01 astro-ph.IM 78%

JAvaScript Multimodal INformation Explorer

Fenja Schweder, Sebastian Trujillo-Gomez, Kai Polsterer

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏