多模态大模型 - arXivDaily 专题

2511.20000 2025-11-26 eess.SP 78%

Cross-Modal Semantic Communication for Heterogeneous Collaborative Perception

跨模态语义通信用于异构协同感知

Mingyi Lu, Guowei Liu, Le Liang, Chongtao Guo, Hao Ye, Shi Jin

专题命中多模态训练与对齐：cross-modal(title,abstract)

AI总结本文提出跨模态语义通信框架，通过统一语义空间实现异构传感器车辆间的高效协同感知，提升低信噪比环境下的感知性能。

2511.18325 2025-11-25 q-bio.NC cs.LG 78%

Brain-MGF: Multimodal Graph Fusion Network for EEG-fMRI Brain Connectivity Analysis Under Psilocybin

Brain-MGF：多模态图融合网络用于psilocybin下EEG-fMRI脑连接分析

Sin-Yee Yap, Fuad Noman, Junn Yong Loo, Devon Stoliker, Moein Khajehnejad, Raphaël C. -W. Phan, David L. Dowe, Adeel Razi, Chee-Ming Ting

机构 * School of Information Technology, Monash University Malaysia（信息技术学院，墨尔本大学马来西亚分校）； Department of Data Science and AI, Faculty of Information Technology, Monash University（数据科学与人工智能系，信息科技学院，墨尔本大学）； Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University（脑与心理健康研究所，心理学科学学院，墨尔本大学）

专题命中多模态训练与对齐：multimodal(title,abstract)

AI总结 Brain-MGF通过多模态图融合网络实现psilocybin下EEG-fMRI脑连接分析，提升冥想和休息状态下的区分准确率与F1分数。

Comments 5 pages

2511.15138 2025-11-20 cs.LG cs.HC 78%

Cross-Modal Consistency-Guided Active Learning for Affective BCI Systems

Hyo-Jeong Jang, Hye-Bin Shin, Kang Yin

机构 * Dept. of Brain and Cognitive Engineering（脑科学与认知工程系）； Korea University（韩国大学）； Dept. of Artificial Intelligence（人工智能系）

专题命中多模态训练与对齐：cross-modal(title,abstract)

2511.10962 2025-11-18 cs.IR 78%

LEMUR: Large scale End-to-end MUltimodal Recommendation

Xintian Han, Honggang Chen, Quan Lin, Jingyue Gao, Xiangyuan Ren, Lifei Zhu, Zhisheng Ye, Shikang Wu, XiongHang Xie, Xiaochu Gan, Bingzheng Wei, Peng Xu, Zhe Wang, Yuchao Zheng, Jingjian Lin, Di Wu, Junfeng Ge

专题命中多模态训练与对齐：multimodal(title,abstract)

2508.10644 2025-11-18 cs.LG 78%

Conditional Information Bottleneck for Multimodal Fusion: Overcoming Shortcut Learning in Sarcasm Detection

Yihua Wang, Qi Jia, Cong Xu, Feiyu Chen, Yuhan Liu, Haotian Zhang, Liang Jin, Lu Liu, Zhichun Wang

机构 * IEIT SYSTEMS Co., Ltd.（IEIT SYSTEMS公司）

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted at AAAI 2026 Conference

2511.06452 2025-11-17 cs.LG 78%

MULTIBENCH++: A Unified and Comprehensive Multimodal Fusion Benchmarking Across Specialized Domains

Leyan Xue, Changqing Zhang, Kecheng Xue, Xiaohong Liu, Guangyu Wang, Zongbo Han

专题命中多模态训练与对齐：multimodal(title,abstract)

2507.04870 2025-11-17 cs.LG 78%

NTSFormer: A Self-Teaching Graph Transformer for Multimodal Isolated Cold-Start Node Classification

Jun Hu, Yufei He, Yuan Li, Bryan Hooi, Bingsheng He

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted by AAAI 2026

2511.08970 2025-11-13 astro-ph.SR 78%

JW-Flare: Accurate Solar Flare Forecasting Method Based on Multimodal Large Language Models

Mingfu Shao, Hui Wang, Yuyang Li, Jiaben Lin, Jifeng Liu, Baolin Tan, Juan Guo, Yin Zhang, Jing Huang, Jiangtao Su, Yingzi Sun, Haiqing Xu, Jie Chen, Suo Liu, Yuanyong Deng, Liyue Tong, Yang Bai, Cunshi Wang, Kaifan Ji, Yuqing Zhou

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 12 pages, 5 figures

2511.06723 2025-11-11 cs.LG 78%

Multi-Modal Continual Learning via Cross-Modality Adapters and Representation Alignment with Knowledge Preservation

Evelyn Chee, Wynne Hsu, Mong Li Lee

机构 * School of Computing, National University of Singapore（computing学院，新加坡国立大学）

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments Accepted to ECAI 2025

Journal ref 28th European Conference on Artificial Intelligence (ECAI), 2025, pp.1083-1090

2511.05716 2025-11-11 cs.LG 78%

Distributionally Robust Multimodal Machine Learning

Peilin Yang, Yu Ma

机构 * University of Wisconsin, Madison（威斯康星大学麦迪逊分校）

专题命中多模态训练与对齐：multimodal(title,abstract)

2511.03196 2025-11-06 cs.LG stat.ML 78%

Cross-Modal Alignment via Variational Copula Modelling

Feng Wu, Tsai Hor Chan, Fuying Wang, Guosheng Yin, Lequan Yu

机构 * School of Computing and Data Science, University of Hong Kong, Hong Kong, China（计算与数据科学学院，香港大学，香港，中国）

专题命中多模态训练与对齐：cross-modal(title)；multimodal(abstract)

Journal ref published by ICML2025

2511.00949 2025-11-04 cs.LG 78%

Motion-Robust Multimodal Fusion of PPG and Accelerometer Signals for Three-Class Heart Rhythm Classification

Yangyang Zhao, Matti Kaisti, Olli Lahdenoja, Tero Koivisto

机构 * Department of Computing, Faculty of Technology, University of Turku（图波大学计算系）

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted for publication in the Companion of the 2025 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2025 International Symposium on Wearable Computers (UbiComp/ISWC 2025 Companion). 5 pages, 3 figures. Author's accepted manuscript (AAM)

2510.21551 2025-10-27 cs.LG 78%

Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment

Jialu Tang, Hung Manh Pham, Ignace De Lathauwer, Henk S. Schipper, Yuan Lu, Dong Ma, Aaqib Saeed

机构 * Eindhoven University of Technology（埃因霍温理工大学）； Singapore Management University（新加坡管理大学）； Maxima Medical Center（马克斯医疗中心）； Erasmus Medical Center（埃因霍温医学院）

专题命中多模态训练与对齐：multimodal(title,abstract)

2510.20976 2025-10-27 cs.LG 78%

L^2M^3OF: A Large Language Multimodal Model for Metal-Organic Frameworks

Jiyu Cui, Fang Wu, Haokai Zhao, Minggao Feng, Xenophon Evangelopoulos, Andrew I. Cooper, Yejin Choi

机构 * Department of Chemistry, University of Liverpool（利兹大学化学系）； Leverhulme Research Centre for Functional Materials Design, University of Liverpool（利兹大学功能性材料设计研究所以）； Department of Computer Science, University of Stanford（斯坦福大学计算机科学系）； School of Computer Science and Engineering, University of New South Wales（新南威尔士大学计算机科学与工程学院）

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 18 pages, 7 figures

2510.18240 2025-10-22 cs.LG 78%

Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignment

Haobin Li, Yijie Lin, Peng Hu, Mouxing Yang, Xi Peng

机构 * College of Computer Science, Sichuan University（四川大学计算机学院）； National Key Laboratory of Fundamental Algorithms and Models for Engineering Numerical Simulation, Sichuan University（四川省工程数值模拟基础算法与模型国家重点实验室）

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 30 pages, 12 figures

2510.16086 2025-10-21 cs.LG stat.AP 78%

FSRF: Factorization-guided Semantic Recovery for Incomplete Multimodal Sentiment Analysis

Ziyang Liu, Pengjunfei Chu, Shuming Dong, Chen Zhang, Mingcheng Li, Jin Wang

机构 * School of Future Science and Engineering, Soochow University（苏州大学未来科学与工程学院）； School of Advanced Manufacturing Engineering, Hefei University（合肥大学先进制造工程学院）； College of Global Talents, BITZH, Beijing Institute of Technology（北京理工大学珠海学院全球人才学院）； Academy for Engineering and Technology, Fudan University（复旦大学工程与技术学院）

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 6 pages,3 figures

Journal ref In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2025)

2510.15953 2025-10-21 cs.CR 78%

Hierarchical Multi-Modal Threat Intelligence Fusion Without Aligned Data: A Practical Framework for Real-World Security Operations

Sisir Doppalapudi

专题命中多模态训练与对齐：multi-modal(title,abstract)

2509.01719 2025-10-21 cs.LG 78%

Robust Anomaly Detection through Multi-Modal Autoencoder Fusion for Small Vehicle Damage Detection

Sara Khan, Mehmed Yüksel, Frank Kirchner

机构 * Faculty of Mathematics and Computer Science, University of Bremen（数学与计算机科学学院，不莱梅大学）； Robotics Innovation Center, Deutsches Forschungszentrum für Künstliche Intelligenz（机器人创新中心，德国人工智能研究中心）； Engineering Software Communication, Robert Bosch GmbH（工程软件通信，罗伯特·博世有限公司）

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 17 pages, 12 figures, submitted to Elsevier MLWA

2411.04863 2025-10-21 cs.LG q-bio.BM 78%

OneProt: Towards Multi-Modal Protein Foundation Models

Klemens Flöge, Srisruthi Udayakumar, Johanna Sommer, Marie Piraud, Stefan Kesselheim, Vincent Fortuin, Stephan Günneman, Karel J van der Weg, Holger Gohlke, Erinc Merdivan, Alina Bazarova

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 34 pages, 7 figures, 11 tables

2508.11666 2025-10-14 eess.SP cs.LG 78%

Explainable Deep Neural Network for Multimodal ECG Signals: Intermediate vs Late Fusion

Timothy Oladunni, Ehimen Aneni

专题命中多模态训练与对齐：multimodal(title,abstract)

2503.22962 2025-10-07 cs.LG cond-mat.mtrl-sci physics.chem-ph 78%

Multimodal machine learning with large language embedding model for polymer property prediction

Tianren Zhang, Dai-Bei Yang

机构 * Department of Materials Science and Engineering, University of Delaware, Newark, Delaware 19716, United States（材料科学与工程系，德雷克塞尔大学）； Department of Chemistry, University of Pennsylvania, Philadelphia, Pennsylvania 19104, United States（化学系，宾夕法尼亚大学）

专题命中多模态训练与对齐：multimodal(title,abstract)

Journal ref Chem. Mater. 2025, 37, 7002-7013

2509.25525 2025-10-01 cs.CR cs.LG 78%

Defeating Cerberus: Concept-Guided Privacy-Leakage Mitigation in Multimodal Language Models

Boyang Zhang, Istemi Ekin Akkus, Ruichuan Chen, Alice Dethise, Klaus Satzke, Ivica Rimac, Yang Zhang

机构 * CISPA Helmholtz Center for Information Security（CISPA赫尔姆霍茨信息安全中心）； Nokia Bell Labs（诺基亚贝尔实验室）

专题命中多模态训练与对齐：multimodal(title,abstract)

2509.24431 2025-09-30 cs.LG 78%

Semantic Compression via Multimodal Representation Learning

Eleonora Grassucci, Giordano Cicchetti, Aurelio Uncini, Danilo Comminiello

机构 * Dept. of Information Engineering, Electronics, and Telecomm.（信息工程、电子与电信系）

专题命中多模态训练与对齐：multimodal(title,abstract)

2509.20840 2025-09-26 cs.LG 78%

Shaping Initial State Prevents Modality Competition in Multi-modal Fusion: A Two-stage Scheduling Framework via Fast Partial Information Decomposition

Jiaqi Tang, Yinsong Xu, Yang Liu, Qingchao Chen

机构 * Institute of Medical Technology, Peking University Health Science Center（北京大学人民医院医学技术研究所）； National Institute of Health Data Science（国家健康数据科学研究院）； State Key Laboratory of General Artificial Intelligence, Peking University（北京大学通用人工智能国家重点实验室）； Wangxuan Institute of Computer Technology, Peking University（北京大学王轩计算机技术研究所）

专题命中多模态训练与对齐：multi-modal(title,abstract)

2509.18005 2025-09-23 cs.RO 78%

M3ET: Efficient Vision-Language Learning for Robotics based on Multimodal Mamba-Enhanced Transformer

Yanxin Zhang, Liang He, Zeyi Kang, Zuheng Ming, Kaixing Zhao

机构 * School of Software Northwestern Polytechnical University Xi'an, China（软件学院西安理工大学西安）； Laboratoire L2Tl University Sorbonne Paris Nord Paris, France（L2Tl实验室索邦巴黎北大学巴黎）

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 8 pages

2509.13636 2025-09-18 cs.LG 78%

Multimodal signal fusion for stress detection using deep neural networks: a novel approach for converting 1D signals to unified 2D images

Yasin Hasanpoor, Bahram Tarvirdizadeh, Khalil Alipour, Mohammad Ghamari

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 14 pages 7 images 2 tables

Journal ref 11760_2025_4734_Article

2406.05300 2025-09-17 eess.SP 78%

Harnessing Multimodal Sensing for Multi-user Beamforming in mmWave Systems

Kartik Patel, Robert W. Heath

专题命中多模态训练与对齐：multimodal(title,abstract)

Journal ref IEEE Trans.Wireless Commun. 23 (2024) 18725-18739

2509.12930 2025-09-17 cs.DC 78%

Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity

Xuefeng Han, Wen Chen, Jun Li, Ming Ding, Qingqing Wu, Kang Wei, Xiumei Deng, Yumeng Shao, Qiong Wu

专题命中多模态训练与对齐：multimodal(title,abstract)

2509.10720 2025-09-17 cs.CY 78%

Adapting Public Personas: A Multimodal Study of U.S. Legislators' Cross-Platform Social Media Strategies

Weihong Qi, Anushka Dave, Chen Ling

专题命中多模态训练与对齐：multimodal(title,abstract)

2509.11187 2025-09-16 cs.CR 78%

DMLDroid: Deep Multimodal Fusion Framework for Android Malware Detection with Resilience to Code Obfuscation and Adversarial Perturbations

Doan Minh Trung, Tien Duc Anh Hao, Luong Hoang Minh, Nghi Hoang Khoa, Nguyen Tan Cam, Van-Hau Pham, Phan The Duy

专题命中多模态训练与对齐：multimodal(title,abstract)

1. 多模态训练与对齐 6903 篇

Cross-Modal Semantic Communication for Heterogeneous Collaborative Perception

Brain-MGF: Multimodal Graph Fusion Network for EEG-fMRI Brain Connectivity Analysis Under Psilocybin

Cross-Modal Consistency-Guided Active Learning for Affective BCI Systems

LEMUR: Large scale End-to-end MUltimodal Recommendation

Conditional Information Bottleneck for Multimodal Fusion: Overcoming Shortcut Learning in Sarcasm Detection

MULTIBENCH++: A Unified and Comprehensive Multimodal Fusion Benchmarking Across Specialized Domains

NTSFormer: A Self-Teaching Graph Transformer for Multimodal Isolated Cold-Start Node Classification

JW-Flare: Accurate Solar Flare Forecasting Method Based on Multimodal Large Language Models

Multi-Modal Continual Learning via Cross-Modality Adapters and Representation Alignment with Knowledge Preservation

Distributionally Robust Multimodal Machine Learning

Cross-Modal Alignment via Variational Copula Modelling

Motion-Robust Multimodal Fusion of PPG and Accelerometer Signals for Three-Class Heart Rhythm Classification

Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment

L^2M^3OF: A Large Language Multimodal Model for Metal-Organic Frameworks

Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignment

FSRF: Factorization-guided Semantic Recovery for Incomplete Multimodal Sentiment Analysis

Hierarchical Multi-Modal Threat Intelligence Fusion Without Aligned Data: A Practical Framework for Real-World Security Operations

Robust Anomaly Detection through Multi-Modal Autoencoder Fusion for Small Vehicle Damage Detection

OneProt: Towards Multi-Modal Protein Foundation Models

Explainable Deep Neural Network for Multimodal ECG Signals: Intermediate vs Late Fusion

Multimodal machine learning with large language embedding model for polymer property prediction

Defeating Cerberus: Concept-Guided Privacy-Leakage Mitigation in Multimodal Language Models

Semantic Compression via Multimodal Representation Learning

Shaping Initial State Prevents Modality Competition in Multi-modal Fusion: A Two-stage Scheduling Framework via Fast Partial Information Decomposition

M3ET: Efficient Vision-Language Learning for Robotics based on Multimodal Mamba-Enhanced Transformer

Multimodal signal fusion for stress detection using deep neural networks: a novel approach for converting 1D signals to unified 2D images

Harnessing Multimodal Sensing for Multi-user Beamforming in mmWave Systems

Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity

Adapting Public Personas: A Multimodal Study of U.S. Legislators' Cross-Platform Social Media Strategies

DMLDroid: Deep Multimodal Fusion Framework for Android Malware Detection with Resilience to Code Obfuscation and Adversarial Perturbations