The rapid evolution of machine learning has propelled neural networks to unprecedented success across diverse domains. In particular, multimodal learning has emerged as a transformative paradigm, leveraging complementary information from heterogeneous data streams (e.g., text, vision, audio) to advance contextual reasoning and intelligent decision-making. Despite these advancements, current neural network-based models often fall short in open-world environments characterized by inherent unpredictability, where unpredictable environmental composition dynamics, incomplete modality inputs, and spurious distributions relations critically undermine system reliability. While humans naturally adapt to such dynamic, ambiguous scenarios, artificial intelligence systems exhibit stark limitations in robustness, particularly when processing multimodal signals under real-world complexity. This study investigates the fundamental challenge of multimodal learning robustness in open-world settings, aiming to bridge the gap between controlled experimental performance and practical deployment requirements.
RobustA: Robust Anomaly Detection in Multimodal Data
Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);IMT School for Advanced Studies(IMT高级研究学院);Johannes Kepler University Linz(林茨约瑟夫·冯·克莱门茨大学);Human-centered AI Group, AI Lab, Linz Institute of Technology(以人为中心的人工智能小组、人工智能实验室、林茨技术研究所)
SWAN: World-Aware Adaptive Multimodal Networks for Runtime Variations
University of California, Los Angeles(加州大学洛杉矶分校);University of California, Riverside(加州大学河滨分校);U.S. Army DEVCOM Army Research Laboratory(美国陆军 DEVCOM 军事研究实验室)
PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecasting
Institute of Computing Technology, Guangzhou University(广州大学计算机技术学院);School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院)
MMBind: Unleashing the Potential of Distributed and Heterogeneous Data for Multimodal Learning in IoT
Hong Kong University of Science and Technology(香港科技大学);University of California, Los Angeles(加州大学洛杉矶分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);U.S. Army DEVCOM Army Research Laboratory(美国陆军DEVCOM陆军研究实验室)
From Efficient Multimodal Models to World Models: A Survey
Fudan University(复旦大学);Academy for Engineering and Technology, Fudan University(复旦大学工程与技术学院);Shanghai Engineering Research Center of AI and Robotics(上海人工智能与机器人工程研究中心);Engineering Research Center of AI and Robotics, Ministry of Education(教育部人工智能与机器人工程研究中心);Shanghai Key Lab of Intelligent Information Processing(上海智能信息处理重点实验室);School of Computer Science, Fudan University(复旦大学计算机科学技术学院)
RobustMAD: Evaluating Real-World Robustness of Multimodal Small Language Models for Deployable Anomaly Detection Assistants
Singapore University of Technology and Design(新加坡科技设计大学);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);Nanyang Technological University(南洋理工大学);Chongqing University(重庆大学)
Multimodal-Guided Dynamic Dataset Pruning for Robust and Efficient Data-Centric Learning
National Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
Robust Multimodal Representation Learning in Healthcare
University of California, Davis(加州大学戴维斯分校);HKUST (GZ)(香港科技大学);University of Rochester(罗切斯特大学);Tongji University(同济大学);Georgia Institute of Technology(佐治亚理工学院);Fudan University(复旦大学);The University of British Columbia(不列颠哥伦比亚大学)
RoHyDR: Robust Hybrid Diffusion Recovery for Incomplete Multimodal Emotion Recognition
School of Computer Science and Engineering(计算机科学与工程学院);South China University of Technology(华南理工大学);School of Future Technology(未来技术学院);University of Oxford(牛津大学);Pengcheng Laboratory(鹏城实验室);Department of Computer Science(计算机科学系)
Robust Multimodal Learning Framework For Intake Gesture Detection Using Contactless Radar and Wearable IMU Sensors
e-Media Research Lab(e-Media研究实验室);ESAT-STADIUS Division, KU Leuven(ESAT-STADIUS部门,KU莱顿大学);M-Group, DistriNet, Department of Computer Science, KU Leuven(M组、DistriNet、计算机科学系,KU莱顿大学)
Training-Free Robust Multimodal Learning via Sample-Wise Jacobian Regularization
Massachusetts Institute of Technology(麻省理工学院);South China University of Technology(华南理工大学);UT-Austin(德克萨斯大学奥斯汀分校);Tsinghua University(清华大学);Shanghai Qizhi Institute(上海期智研究院)