Quantum federated learning (QFL) has been recently introduced to enable a distributed privacy-preserving quantum machine learning (QML) model training across quantum processors (clients). Despite recent research efforts, existing QFL frameworks predominantly focus on unimodal systems, limiting their applicability to real-world tasks that often naturally involve multiple modalities. To fill this significant gap, we present for the first time a novel multimodal approach specifically tailored for the QFL setting with the intermediate fusion using quantum entanglement. Furthermore, to address a major bottleneck in multimodal QFL, where the absence of certain modalities during training can degrade model performance, we introduce a Missing Modality Agnostic (MMA) mechanism that isolates untrained quantum circuits, ensuring stable training without corrupted states. Simulation results demonstrate that the proposed multimodal QFL method with MMA yields an improvement in accuracy of 6.84% in independent and identically distributed (IID) and 7.25% in non-IID data distributions compared to the state-of-the-art methods.
Boosting Multimodal Federated Learning via Chained Modality Optimization
School of Computer Science and Engineering, Tianjin University of Technology, Tianjin, China(天津理工大学计算机科学与工程学院);Institute of Automation, Chinese Academy of Sciences, Beijing, China(中国科学院自动化研究所);College of Computer Science, Inner Mongolia University, Hohhot, Inner Mongolia, China(内蒙古大学计算机学院)
Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstruction
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究所);Guangxi Medical University(广西医科大学);The Hong Kong University of Science and Technology(香港科技大学)
ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities
NepAl Applied Mathematics and Informatics Institute(尼泊尔应用数学与信息学研究所);Fogsphere (Redev.AI Ltd)(福格球(Redev.AI有限公司));University of Lausanne(洛桑大学);West Virginia University(西弗吉尼亚大学);University of Verona(维罗纳大学);University College London(伦敦大学学院);University of Aberdeen(阿伯丁大学)
Twins-PainViT: Towards a Modality-Agnostic Vision Transformer Framework for Multimodal Automatic Pain Assessment using Facial Videos and fNIRS
Computational Biomedicine Laboratory of the Foundation for Research and Technology (FORTH)(希腊国家研究与技术基金会计算生物医学实验室);Department of Electrical & Computer Engineering Hellenic Mediterranean University(希腊地中海大学电气与计算机工程系)
Modality-Decoupled Federated Learning for Privacy-Preserving Embodied Intelligence in 6G
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Shanghai Jiao Tong University(上海交通大学);Eastern Institute of Technology(东方理工大学);ITMO University(圣彼得堡国立信息技术机械与光学大学);University of Hong Kong(香港大学);Singapore University of Technology and Design(新加坡科技设计大学);Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
ClusMFL: A Cluster-Enhanced Framework for Modality-Incomplete Multimodal Federated Learning in Brain Imaging Analysis
School of Science and Engineering, the Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)理工学院);Department of Computer Science and Engineering, Lehigh University(利哈伊大学计算机科学与工程系);Department of Computer Science, Emory University(埃默里大学计算机科学系)
FedUAF: Uncertainty-Aware Fusion with Reliability-Guided Aggregation for Multimodal Federated Sentiment Analysis
Shanghai University(上海大学);North China Electric Power University(华北电力大学);Université de Technologie de Compiègne(法国图卢兹国立理工学院);Nanyang Technological University(南洋理工大学);City University of Hong Kong(香港城市大学);Macquarie University(麦考瑞大学)
FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality Brain Image Synthesis
Southern University of Science and Technology(南方科技大学);University of Surrey(萨里大学);Tencent(腾讯);University of Chinese Academy of Sciences(中国科学院大学);Peng Cheng Laboratory(鹏城实验室);Bielefeld University(比勒费尔德大学)
Modality-Agnostic Input Channels Enable Segmentation of Brain lesions in Multimodal MRI with Sequences Unavailable During Training
Department of Engineering Science, University of Oxford, Oxford, UK(工程科学系,牛津大学,牛津,英国);Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK(牛津大学临床神经科学系,牛津,英国)
Multimodal Federated Learning via Contrastive Representation Ensemble
Institute for AI Industry Research, Tsinghua University(清华大学人工智能产业研究院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);University of Waterloo(滑铁卢大学);Carnegie Mellon University(卡内基梅隆大学)
FreeSliders: Training-Free, Modality-Agnostic Concept Sliders for Fine-Grained Diffusion Control in Images, Audio, and Video
Faculty of Computer and Information Science, Ben-Gurion University of the Negev(计算机与信息科学学院,贝内-约尔大学纳格尔分校);Lightricks(Lightricks公司);School of Electrical and Computer Engineering, Ben-Gurion University of the Negev(电气与计算机工程学院,贝内-约尔大学纳格尔分校)
FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning
University of Southern Queensland(南昆士兰大学);Wuhan University of Technology(武汉理工大学);Lingnan University(岭南大学);University of Electronic Science and Technology of China(电子科技大学);Hong Kong Polytechnic University(香港理工大学)
Learning Reconfigurable Representations for Multimodal Federated Learning with Missing Data
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Washington State University(华盛顿州立大学);VinUniversity(文大学);Griffin University(格里芬大学);Hanoi University of Science and Technology(河内科学技术大学)
Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning
The University of British Columbia(英属哥伦比亚大学);Fudan University(复旦大学);Royal College of Science, Imperial College London(伦敦帝国理工学院皇家科学学院);Dyson School of Design Engineering(戴森设计工程学院);Suzhou Institute of Biomedical Engineering and Technology (SIBET), Chinese Academy of Sciences(中国科学院苏州生物医学工程技术研究所);East China Normal University(华东师范大学)
UMEDA: Unified Multi-modal Efficient Data Fusion for Privacy-Preserving Graph Federated Learning via Spectral-Gated Attention and Diffusion-Based Operator Alignment
Department of XXX, University of YYY, Location, Country(XXX系,YYY大学,Location,Country);School of ZZZ, Institute of WWW, Location, Country(ZZZ学院,WWW研究所,Location,Country)
Detecting Dataset Bias in Medical AI: A Generalized and Modality-Agnostic Auditing Framework
The Johns Hopkins University(约翰霍普金斯大学);The Johns Hopkins University Applied Physics Laboratory(约翰霍普金斯大学应用物理实验室);Center for Devices and Radiological Health, U.S. Food and Drug Administration(美国食品药品监督管理局设备与放射健康中心)