In recent advancements in machine learning, federated learning allows a network of distributed clients to collaboratively develop a global model without needing to share their local data. This technique aims to safeguard privacy, countering the vulnerabilities of conventional centralized learning methods. Traditional federated learning approaches often rely on a central server to coordinate model training across clients, aiming to replicate the same model uniformly across all nodes. However, these methods overlook the significance of geographical and local data variances in vast networks, potentially affecting model effectiveness and applicability. Moreover, relying on a central server might become a bottleneck in large networks, such as the ones promoted by edge computing. Our paper introduces a novel, fully-distributed federated learning strategy called proximity-based self-federated learning that enables the self-organised creation of multiple federations of clients based on their geographic proximity and data distribution without exchanging raw data. Indeed, unlike traditional algorithms, our approach encourages clients to share and adjust their models with neighbouring nodes based on geographic proximity and model accuracy. This method not only addresses the limitations posed by diverse data distributions but also enhances the model's adaptability to different regional characteristics creating specialized models for each federation. We demonstrate the efficacy of our approach through simulations on well-known datasets, showcasing its effectiveness over the conventional centralized federated learning framework.
Learning Critically: Selective Self Distillation in Federated Learning on Non-IID Data
Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences and the University of Chinese Academy of Sciences(北京移动计算与 pervasive 设备重点实验室,计算技术研究所,中国科学院和中国科学院大学);Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences(北京移动计算与 pervasive 设备重点实验室,计算技术研究所,中国科学院);Shandong Academy of Intelligent Computing Technology(山东省智能计算技术研究院);Frontier Sciences and Education, Chinese Academy of Sciences(前沿科学与教育,中国科学院)
SCALE: Self-regulated Clustered federAted LEarning in a Homogeneous Environment
School of Computing(计算机学院);Southern Illinois University Carbondale(南伊利诺伊大学卡本代尔分校);The University of Texas at Arlington(德克萨斯大学阿灵顿分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancer
Zhejiang University(浙江大学);The Hong Kong University of Science and Technology(香港科技大学);Angelalign Technology Inc(时代天使科技有限公司);State Key Laboratory of Oral Diseases, Sichuan University(四川大学口腔疾病研究国家重点实验室);Singapore University of Technology and Design(新加坡科技设计大学)
Department of Engineering, University of Palermo, Palermo, Italy(工程系,帕尔梅罗大学);Department of Computer Science, Missouri University of Science and Technology, Rolla, USA(计算机科学系,密苏里科技大学);Department of Computer Science, BITS-Pilani, Dubai, UAE(计算机科学系,比斯帕利尼学院)
Personalized Federated Learning via Backbone Self-Distillation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, UCAS(中国科学院大学网络空间安全学院);School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);School of Automation, Hangzhou Dianzi University(杭州电子科技大学自动化学院)
Tackling Heterogeneity in Federated Learning via Variance-Reduced Boltzmann Sampling within Homogeneous Social Coalitions
Department of Mathematical Sciences, Politecnico di Torino(数学科学系,都灵理工学院);Istituto Nazionale di Fisica Nucleare, Sezione di Torino(国家核物理研究所,都灵分所);Department of Electronics and Telecommunications, Politecnico di Torino(电子与电信系,都灵理工学院)
Concordia: Self-Improving Synthetic Tables for Federated LLMs
University of Manchester(曼彻斯特大学);National University of Singapore(新加坡国立大学);New York University(纽约大学);University of Minnesota(明尼苏达大学);Halmstad University(哈姆斯塔德大学);Harvard University(哈佛大学);University of Florida(佛罗里达大学)
FedBC: Calibrating Global and Local Models via Federated Learning Beyond Consensus
University of Maryland, College Park(马里兰大学帕克分校);University of British Columbia(不列颠哥伦比亚大学);JP Morgan Chase AI Research(摩根大通人工智能研究院);Amazon(亚马逊);DEVCOM Army Research Laboratory(美国陆军作战能力发展司令部陆军研究实验室)
FedThief: Harming Others to Benefit Oneself in Self-Centered Federated Learning
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University(航空信息安全与可信计算重点实验室、教育部、网络安全科学与工程学院、武汉大学);School of Computer Science, Taikang Center for Life and Medical Sciences, Wuhan University(计算机学院、泰康生命与医学科学中心、武汉大学)
Federated Class-Incremental Learning with New-Class Augmented Self-Distillation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhongguancun Laboratory(中关村实验室);Beijing Jiaotong University(北京交通大学)
Boosting multi-demographic federated learning for chest radiograph analysis using general-purpose self-supervised representations
University Hospital RWTH Aachen(亚琛工业大学附属医院);Hamedan University of Technology(哈马丹理工大学);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡大学);Stanford University(斯坦福大学)
Local K-Similarity Constraint for Federated Learning with Label Noise
NAAMII, Nepal Applied Mathematics and Informatics Institute for Research(NAAMII尼泊尔应用数学与信息学研究所);Rochester Institute of Technology(罗切斯特技术研究所);West Virginia University(西弗吉尼亚大学);University of Lausanne(洛桑大学);Ulsan National Institute of Science & Technology(釜山国家科学与技术研究所);University of Aberdeen(阿伯丁大学)
Beyond Model Scale Limits: End-Edge-Cloud Federated Learning with Self-Rectified Knowledge Agglomeration
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhongguancun Laboratory(中关村实验室);Tsinghua University(清华大学);Beijing Jiaotong University(北京交通大学)