Federated learning (FL) is a subfield of machine learning that avoids sharing local data with a central server, which can enhance privacy and scalability. The inability to consolidate data leads to a unique problem called dataset imbalance, where agents in a network do not have equal representation of the labels one is trying to learn to predict. In FL, fusing locally-trained models with unbalanced datasets may deteriorate the performance of global model aggregation, and reduce the quality of updated local models and the accuracy of the distributed agents' decisions. In this work, we introduce an Optimal Transport-based preprocessing algorithm that aligns the datasets by minimizing the distributional discrepancy of data along the edge devices. We accomplish this by leveraging Wasserstein barycenters when computing channel-wise averages. These barycenters are collected in a trusted central server where they collectively generate a target RGB space. By projecting our dataset towards this target space, we minimize the distributional discrepancy on a global level, which facilitates the learning process due to a minimization of variance across the samples. We demonstrate the capabilities of the proposed approach over the CIFAR-10 dataset, where we show its capability of reaching higher degrees of generalization in fewer communication rounds.
Distribution Alignment for One-Shot Federated Learning via Optimal Transport
AI for Good (AIGO), Italian Institute of Technology(意大利技术研究院AI for Good (AIGO));MaLGa-DIBRIS, University of Genoa(热那亚大学MaLGa-DIBRIS);Department of Computer Science, University of Verona(维罗纳大学计算机科学系)
Exploiting Test-Time Augmentation in Federated Learning for Brain Tumor MRI Classification
Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil(精确与技术科学研究所,弗拉维亚联邦大学-UFV,里奥帕拉纳伊巴-MG,巴西);Department of Computing, Federal University of São Carlos, São Carlos-SP, Brazil(计算系,萨o卡洛斯联邦大学,萨o卡洛斯-SP,巴西)
FIRM: Federated In-client Regularized Multi-objective Alignment for Large Language Models
Department of Electrical and Computer Engineering, The Ohio State University, Columbus, OH, USA(电气与计算机工程系,俄亥俄州立大学,哥伦布,OH,USA);Department of Computer Science and Engineering, The Ohio State University, Columbus, OH, USA(计算机科学与工程系,俄亥俄州立大学,哥伦布,OH,USA)
Beyond Rigid Alignment: Graph Federated Learning via Dual Manifold Calibration
School of Computer Science and Engineering(计算机科学与工程学院);Nanjing University of Science and Technology(南京理工大学);Department of Computer Science(计算机科学系);Hong Kong Baptist University(香港 Baptist 大学);School of Automation and Intelligent Sensing(自动化与智能感知学院)
RefProtoFL: Communication-Efficient Federated Learning via External-Referenced Prototype Alignment
College of Intelligence and Computing, Tianjin University(智能与计算学院,天津大学);State Key Lab. for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学);Yunnan Key Lab. of Service Computing, Yunnan University of Finance and Economics(云南服务计算重点实验室,云南财经大学)
Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignment
College of Computing and Data Science, Nanyang Technological University, Singapore.(南洋理工大学计算机与数据科学学院);Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, Canada.(不列颠哥伦比亚大学电子与计算机工程系);Vector Institute, Canada(加拿大向量研究所);The Hong Kong Polytechnic University(香港理工大学)
Defending Against Backdoor Attacks via Alignment Checking in Model-Contrastive Federated Learning
Shandong Computer Science Center(山东计算机科学中心);Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));College of computer science and technology, China University of Petroleum(中国石油大学计算机科学与技术学院);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Big Data Institute, Qilu University of Technology(齐鲁工业大学大数据研究院)
Federated Variational Preference Alignment with Gumbel-Softmax Prior for Personalized User Preferences
Graduate School of AI, POSTECH, Pohang, Republic of Korea(POSTECH人工智能研究生院);Department of CSE, POSTECH, Pohang, Republic of Korea(POSTECH计算机科学与工程系);National AI Research Lab, Seoul, Republic of Korea(首尔国家人工智能研究实验室)
FedPDPO: Federated Personalized Direct Preference Optimization for Large Language Model Alignment
College of Intelligence and Computing, Tianjin University, Tianjin, China(智能与计算学院,天津大学,天津,中国);College of Computing and Data Science, Nanyang Technological University, Singapore(计算与数据科学学院,南洋理工大学,新加坡)
Personalized Federated Learning for Spatio-Temporal Forecasting: A Dual Semantic Alignment-Based Contrastive Approach
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
From Coordinate Matching to Structural Alignment: Rethinking Prototype Alignment in Heterogeneous Federated Learning
State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University(虚拟现实技术与系统国家重点实验室,计算机科学与工程学院,北京航空航天大学);Zhongguancun Laboratory(中关村实验室);Center for AI Business Innovation, Department of Management Science and Systems, School of Management, University at Buffalo(人工智能商业创新中心,管理科学与系统系,布法罗大学)
Federated Mixture-of-Experts Alignment on Mobile Edge Networks under Data Heterogeneity
Hong Kong JC STEM Lab of Smart City(香港JC STEM实验室);Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);School of Computer Science and Technology, Xidian University(西安电子科技大学计算机科学与技术学院);Department of Electrical and Computer Engineering, The University of Hong Kong(香港大学电子与计算机工程系)