Multimodal large language models (MLLMs) can process diverse inputs, e.g., text, images, audio, and video, and generate textual responses. While their capabilities have advanced rapidly, evaluation of such models has not kept pace. Most existing evaluation benchmarks are limited to isolated tasks and reveal little about whether a model integrates information across modalities. We examine current means for evaluating MLLMs and review the existing benchmark taxonomy to identify gaps, including temporal-spatial coherence, physical world understanding, multimodal consistency, and selective attention. Addressing these gaps is essential for measuring real progress in multimodal intelligence and exposing capability boundaries.
Multimodal Prompt Learning with Irregular EHRs for Robust Monitoring of Critical Care Patients
Faculty of Engineering, Shenzhen MSU-BIT University(深圳北理莫斯科大学工程学院);International School, Beijing University of Posts and Telecommunications(北京邮电大学国际学院);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);School of Artificial Intelligence and Computer Science, Jiangnan University(江南大学人工智能与计算机学院)
Deep Multimodal Learning with Missing Modality: A Survey
The Australian National University(澳大利亚国立大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Adelaide University(阿德莱德大学);The University of Surrey(萨里大学)
PAMF: Prior-Aware Multimodal Fusion for Incomplete Time Series Data
Department of Computer Science, University of Central Florida(中央佛罗里达大学计算机科学系);Department of Computer Science, University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校计算机科学系)
ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities
NepAl Applied Mathematics and Informatics Institute(尼泊尔应用数学与信息学研究所);Fogsphere (Redev.AI Ltd)(福格球(Redev.AI有限公司));University of Lausanne(洛桑大学);West Virginia University(西弗吉尼亚大学);University of Verona(维罗纳大学);University College London(伦敦大学学院);University of Aberdeen(阿伯丁大学)
Learning Reconfigurable Representations for Multimodal Federated Learning with Missing Data
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Washington State University(华盛顿州立大学);VinUniversity(文大学);Griffin University(格里芬大学);Hanoi University of Science and Technology(河内科学技术大学)
PRIME: Prototype-Driven Multimodal Pretraining for Cancer Prognosis with Missing Modalities
University of Minnesota(明尼苏达大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);North Carolina State University(北卡罗来纳州立大学);National University of Singapore(新加坡国立大学);Institute of High Performance Computing, Agency for Science, Technology and Research(高性能计算研究所,新加坡科技研究局)
RoHyDR: Robust Hybrid Diffusion Recovery for Incomplete Multimodal Emotion Recognition
School of Computer Science and Engineering(计算机科学与工程学院);South China University of Technology(华南理工大学);School of Future Technology(未来技术学院);University of Oxford(牛津大学);Pengcheng Laboratory(鹏城实验室);Department of Computer Science(计算机科学系)
Multimodal Sentiment Analysis with Missing Modality: A Knowledge-Transfer Approach
College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算机与数据科学学院);Singapore University of Social Sciences, Singapore(新加坡社会科学研究大学)
Causal Debiasing Medical Multimodal Representation Learning with Missing Modalities
DataLab: Data Science and Informatics, University of California, Davis(加州大学戴维斯分校数据实验室);Department of Electrical and Computer Engineering, University of Rochester(罗切斯特大学电气与计算机工程系);Academy for Engineering & Technology, Fudan University(复旦大学工程与技术学院);Department of Computer Science, University of Toronto(多伦多大学计算机科学系);Department of Electrical and Computer Engineering, New York University(纽约大学电气与计算机工程系);UC Davis Health(加州大学戴维斯分校医疗中心);Department of Basic Medical Sciences, University of Arizona(亚利桑那大学基础医学系);Department of Computer Science, University of California, Davis(加州大学戴维斯分校计算机科学系)
A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarios
Institute of Computational Perception, Johannes Kepler University Linz(约翰开普勒林茨大学计算感知研究所);Human-centered AI Group, AI Lab, Linz Institute of Technology(林茨理工大学人工智能实验室以人为中心的人工智能组)
Robust Multispectral Semantic Segmentation under Missing or Full Modalities via Structured Latent Projection
Department of Computer Engineering, Ankara University(安卡拉大学计算机工程系);Department of Modeling and Simulation, Graduate School of Informatics, METU(信息学院建模与模拟系,METU)
Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer
Unit of Artificial Intelligence and Computer Systems, Department of Engineering(人工智能与计算机系统单位,工程系);Università Campus Bio-Medico di Roma(罗马生物医学大学);Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering(诊断与介入部门,辐射物理,生物医学工程);Umeå University(乌梅学院);Research Unit of Radiation Oncology, Department of Medicine and Surgery(放射肿瘤研究单位,医学与外科部门);Fondazione Policlinico Universitario Campus Bio-Medico(生物医学大学附属医院基金会);Anatomical Pathology Operative Research Unit(解剖病理学操作研究单位);Research Unit of Anatomical Pathology, Department of Medicine and Surgery(解剖病理学研究单位,医学与外科部门);Department of Medicine and Surgery(医学与外科部门)
Latent Space Guided Scenario Sampling for Multimodal Segmentation Under Missing Modalities
organization= Department of Computer Engineering, Ankara University, Ankara, T \"u rkiye;organization= Department of Modeling;Simulation, Graduate School of Informatics, METU, Ankara, T \"u rkiye
When Does Multimodal Learning Help in Healthcare? A Benchmark on EHR and Chest X-Ray Fusion
Department of Computer Science(计算机科学系);Hong Kong Baptist University(香港 Baptist 大学);Division of Artificial Intelligence(人工智能 division);Lingnan University(Lingnan 大学);School of Nursing(护理学院);The Hong Kong Polytechnic University(香港理工大学)