Availability of large, diverse, and multi-national datasets is crucial for the development of effective and clinically applicable AI systems in the medical imaging domain. However, forming a global model by bringing these datasets together at a central location, comes along with various data privacy and ownership problems. To alleviate these problems, several recent studies focus on the federated learning paradigm, a distributed learning approach for decentralized data. Federated learning leverages all the available data without any need for sharing collaborators' data with each other or collecting them on a central server. Studies show that federated learning can provide competitive performance with conventional central training, while having a good generalization capability. In this work, we have investigated several federated learning approaches on the brain tumor segmentation problem. We explore different strategies for faster convergence and better performance which can also work on strong Non-IID cases.
University of Pennsylvania（宾夕法尼亚大学）；Perelman School of Medicine（佩雷尔曼医学院）；Technical University of Munich（慕尼黑工业大学）；Stony Brook University（石溪大学）
We evaluate the performance of federated learning (FL) in developing deep learning models for analysis of digitized tissue sections. A classification application was considered as the example use case, on quantifiying the distribution of tumor infiltrating lymphocytes within whole slide images (WSIs). A deep learning classification model was trained using 50*50 square micron patches extracted from the WSIs. We simulated a FL environment in which a dataset, generated from WSIs of cancer from numerous anatomical sites available by The Cancer Genome Atlas repository, is partitioned in 8 different…
Exploiting Test-Time Augmentation in Federated Learning for Brain Tumor MRI Classification
Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil（精确与技术科学研究所，弗拉维亚联邦大学-UFV，里奥帕拉纳伊巴-MG，巴西）；Department of Computing, Federal University of São Carlos, São Carlos-SP, Brazil（计算系，萨o卡洛斯联邦大学，萨o卡洛斯-SP，巴西）
Generalizable Hyperparameter Optimization for Federated Learning on Non-IID Cancer Images
Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil（精确与技术科学研究所，弗拉维亚联邦大学-UFV，里奥帕拉纳伊巴-巴西）；Department of Computing, Federal University of São Carlos, São Carlos-SP, Brazil（计算系，圣卡洛斯联邦大学，圣卡洛斯-巴西）
Enhanced Liver Tumor Detection in CT Images Using 3D U-Net and Bat Algorithm for Hyperparameter Optimization
Department of Mathematics and Statistics, Loyola University Chicago（洛约拉大学芝加哥分校数学与统计学系）；Department of Mathematics and Computer Science, Islamic Azad University, Science and Research Branch（伊斯兰 Azad 大学科学与研究分校数学与计算机科学系）
本文提出将 3D U-Net 架构与 Bat Algorithm 结合，通过优化学习率和批大小等超参数实现 CT 图像中肝肿瘤的自动分割，有效提升了分割精度与鲁棒性。
Federated Learning (FL) decouples model training from the need for direct access to the data and allows organizations to collaborate with industry partners to reach a satisfying level of performance without sharing vulnerable business information. The performance of a machine learning algorithm is highly sensitive to the choice of its hyperparameters. In an FL setting, hyperparameter optimization poses new challenges. In this work, we investigated the impact of different hyperparameter optimization approaches in an FL system. In an effort to reduce communication costs, a critical bottleneck in…
The MICCAI Federated Tumor Segmentation (FeTS) Challenge 2024: Efficient and Robust Aggregation Methods for Federated Learning
Department of Pathology and Laboratory Medicine, Indiana University School of Medicine（印第安纳大学医学院病理学与实验室医学系）；Center for Federated Learning in Medicine, Indiana University School of Medicine（印第安纳大学医学院医学联邦学习中心）；Medical AI Group, MLCommons（MLCommons医学人工智能小组）；Intel Corporation（英特尔公司）；Sage Bionetworks（Sage生物网络）；Turku University of Applied Sciences（图尔库应用科学大学）；Stanford University（斯坦福大学）；Ecole Normale Supérieure（巴黎高等师范大学）；Technical University of Munich（慕尼黑技术大学）；Weill Cornell Medicine（韦尔医学院）；Ezri AI Labs（Ezri AI实验室）；City St George’s, University of London（伦敦大学城市学院）；Imperial College London（伦敦帝国学院）；Seoul National University（首尔国立大学）；Ostbayerische Technische Hochschule (OTH) Regensburg（雷根斯堡应用技术大学）；Universität Zürich（苏黎世大学）；Kingston University London（伦敦金史密斯学院）；Departments of Radiology and Imaging Sciences（印第安纳大学医学院放射学与影像科学系；神经外科系；生物统计学与健康数据科学系）；Neurological Surgery（印第安纳大学计算机科学系；Luddy信息学、计算与工程学院）；Biostatistics and Health Data Science, Indiana University School of Medicine；Department of Computer Science, Luddy School of Informatics, Computing and Engineering, Indiana University
Hyperparameter optimization (HPO) is crucial for machine learning algorithms to achieve satisfactory performance, whose progress has been boosted by related benchmarks. Nonetheless, existing efforts in benchmarking all focus on HPO for traditional centralized learning while ignoring federated learning (FL), a promising paradigm for collaboratively learning models from dispersed data. In this paper, we first identify some uniqueness of HPO for FL algorithms from various aspects. Due to this uniqueness, existing HPO benchmarks no longer satisfy the need to compare HPO methods in the FL setting. …
Faculty of Computer Science, AGH University of Krakow（计算机科学系，克拉科夫AGH大学）；Department of Informatics, Universitas Pembangunan Nasional Veteran Yogyakarta（信息系，全国 veterans 大学 Yogya 市）
Naval Information Warfare Center Pacific（太平洋海军信息战中心）
In this work, we explore combining automatic hyperparameter tuning and optimization for federated learning (FL) in an online, one-shot procedure. We apply a principled approach on a method for adaptive client learning rate, number of local steps, and batch size. In our federated learning applications, our primary motivations are minimizing communication budget as well as local computational resources in the training pipeline. Conventionally, hyperparameter tuning methods involve at least some degree of trial-and-error, which is known to be sample inefficient. In order to address our motivation…
University of Alberta（阿尔伯塔大学）；University of Hradec Králové（赫拉德茨-克拉洛韦大学）
Electrical load prediction has become an integral part of power system operation. Deep learning models have found popularity for this purpose. However, to achieve a desired prediction accuracy, they require huge amounts of data for training. Sharing electricity consumption data of individual households for load prediction may compromise user privacy and can be expensive in terms of communication resources. Therefore, edge computing methods, such as federated learning, are gaining more importance for this purpose. These methods can take advantage of the data without centrally storing it. This p…
Intel Corporation（英特尔公司）；University of Pennsylvania（宾夕法尼亚大学）
Deep learning models for semantic segmentation of images require large amounts of data. In the medical imaging domain, acquiring sufficient data is a significant challenge. Labeling medical image data requires expert knowledge. Collaboration between institutions could address this challenge, but sharing medical data to a centralized location faces various legal, privacy, technical, and data-ownership challenges, especially among international institutions. In this study, we introduce the first use of federated learning for multi-institutional collaboration, enabling deep learning modeling with…
FedOnco-Bench: A Reproducible Benchmark for Privacy-Aware Federated Tumor Segmentation with Synthetic CT Data
College of Business Administration Kansas State University Manhattan, USA（商学院 Kansas State University 美国曼哈顿）；Department of Computer Science Kansas State University Manhattan, USA（计算机科学系 Kansas State University 美国曼哈顿）
The Federated Tumor Segmentation and Classification (FeTS++) Challenge
Indiana University School of Medicine（印第安纳大学医学院）；Indiana University Melvin and Bren Simon Comprehensive Cancer Center（印第安纳大学梅尔文与布伦·西蒙综合癌症中心）；Sage Bionetworks（赛奇生物网络公司）；MLCommons（机器学习通用任务组织）；NVIDIA（英伟达公司）；Indiana University（印第安纳大学）
Federated Modality-specific Encoders and Partially Personalized Fusion Decoder for Multimodal Brain Tumor Segmentation
National Institute for Data Science in Health and Medicine（国家医学数据科学研究院）；Department of Computer Science at School of Informatics（信息学院计算机科学系）；Jarvis Research Center（Jarvis研究中心）；Medical Artificial Intelligence Lab（医学人工智能实验室）
Universidade Federal Fluminense（弗鲁米嫩塞联邦大学）；Trinity College Dublin（都柏林圣三一学院）
Fast identification of new network attack patterns is crucial for improving network security. Nevertheless, identifying an ongoing attack in a heterogeneous network is a non-trivial task. Federated learning emerges as a solution to collaborative training for an Intrusion Detection System (IDS). The federated learning-based IDS trains a global model using local machine learning models provided by federated participants without sharing local data. However, optimization challenges are intrinsic to federated learning. This paper proposes the Federated Simulated Annealing (FedSA) metaheuristic to s…
Revisit the Stability of Vanilla Federated Learning Under Diverse Conditions
School of Electrical Engineering, KAIST（韩国科学技术院电气工程学院）；Department of Applied AI, Hansung University（韩星大学应用人工智能系）；Data Center and AI Group, Intel Corporation（英特尔公司数据中心与人工智能集团）
While federated learning is a promising approach for training deep learning models over distributed sensitive datasets, it presents new challenges for machine learning, especially when applied in the medical domain where multi-centric data heterogeneity is common. Building on previous domain adaptation works, this paper proposes a novel federated learning approach for deep learning architectures via the introduction of local-statistic batch normalization (BN) layers, resulting in collaboratively-trained, yet center-specific models. This strategy improves robustness to data heterogeneity while …
Turku University of Applied Sciences（图尔库应用科学大学）；Riphah International University（里法哈国际大学）
In federated learning (FL), the global model at the server requires an efficient mechanism for weight aggregation and a systematic strategy for collaboration selection to manage and optimize communication payload. We introduce a practical and cost-efficient method for regularized weight aggregation and propose a laborsaving technique to select collaborators per round. We illustrate the performance of our method, regularized similarity weight aggregation (RegSimAgg), on the Federated Tumor Segmentation (FeTS) 2022 challenge's federated training (weight aggregation) problem. Our scalable approac…
École Normale Supérieure（巴黎高等师范学院）；Technical University Munich（慕尼黑工业大学）；Klinikum rechts der Isar（伊萨尔河右岸医院）；Helmholtz Zentrum Muenchen（亥姆霍兹慕尼黑中心）
We propose a simple new aggregation strategy for federated learning that won the MICCAI Federated Tumor Segmentation Challenge 2021 (FETS), the first ever challenge on Federated Learning in the Machine Learning community. Our method addresses the problem of how to aggregate multiple models that were trained on different data sets. Conceptually, we propose a new way to choose the weights when averaging the different models, thereby extending the current state of the art (FedAvg). Empirical validation demonstrates that our approach reaches a notable improvement in segmentation performance compar…
Singapore University of Design and Technology（新加坡科技设计大学）；East China Normal University（华东师范大学）；University of Electronic Science and Technology of China（电子科技大学）；Beihang University（北京航空航天大学）
Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant advantages in fast adaptation and convergence over heterogeneous datasets. However, existing research simply combines MAML and FL without explicitly addressing how much benefit MAML brings to FL and how to maximize such benefit over mobile edge networks. In this paper, we quantify the benefit from two aspects: optimizing FL hyperparameters (i.e., sampled data si…
University of Science and Technology of China（中国科学技术大学）；Quzhou University（衢州学院）
The most recent multi-source covariate shift algorithm is an efficient hyperparameter optimization algorithm for missing target output. In this paper, we extend this algorithm to the framework of federated learning. For data islands in federated learning and covariate shift adaptation, we propose the federated domain adaptation estimate of the target risk which is asymptotically unbiased with a desirable asymptotic variance property. We construct a weighted model for the target task and propose the federated covariate shift adaptation algorithm which works preferably in our setting. The effica…
Yale University（耶鲁大学）；Renmin University of China（中国人民大学）；JD Technology Group（京东科技集团）
Federated learning, conducive to solving data privacy and security problems, has attracted increasing attention recently. However, the existing federated boosting model sequentially builds a decision tree model with the weak base learner, resulting in redundant boosting steps and high interactive communication costs. In contrast, the federated bagging model saves time by building multi-decision trees in parallel, but it suffers from performance loss. With the aim of obtaining an outstanding performance with less time cost, we propose a novel model in a vertically federated setting termed as Fe…
Theoretically Principled Federated Learning for Balancing Privacy and Utility
Huazhong University of Science and Technology（华中科技大学）；Tsinghua University（清华大学）；Peng Cheng Laboratory（鹏城实验室）；WeBank（微众银行）；The Hong Kong Polytechnic University（香港理工大学）
Federated learning is a machine learning technique that enables training across decentralized data. Recently, federated learning has become an active area of research due to an increased focus on privacy and security. In light of this, a variety of open source federated learning libraries have been developed and released. We introduce FedJAX, a JAX-based open source library for federated learning simulations that emphasizes ease-of-use in research. With its simple primitives for implementing federated learning algorithms, prepackaged datasets, models and algorithms, and fast simulation speed, …
Bridging Data Barriers among Participants: Assessing the Potential of Geoenergy through Federated Learning
Ningbo Institute of Digital Twin, Eastern Institute of Technology（宁波数字孪生研究院，东方理工大学）；The Hong Kong Polytechnic University（香港理工大学）；Shanghai Jiao Tong University（上海交通大学）；Research Institute for Smart Energy, The Hong Kong Polytechnic University（香港理工大学智慧能源研究院）
Federated learning (FL) is a well established method for performing machine learning tasks over massively distributed data. However in settings where data is distributed in a non-iid (not independent and identically distributed) fashion -- as is typical in real world situations -- the joint model produced by FL suffers in terms of test set accuracy and/or communication costs compared to training on iid data. We show that learning a single joint model is often not optimal in the presence of certain types of non-iid data. In this work we present a modification to FL by introducing a hierarchical…
CERN（欧洲核子研究组织）；Masaryk University（马萨里克大学）；National & Kapodistrian University of Athens（雅典国立与卡波迪斯特里亚大学）；Democritus University of Thrace（德谟克利特色雷斯大学）；University Hospital Brno（布尔诺大学医院）
MedFedPure: A Medical Federated Framework with MAE-based Detection and Diffusion Purification for Inference-Time Attacks
School of Electrical and Computer Engineering（电气与计算机工程学院）；Max Planck Institute for Brain Research（马克斯·普朗克脑研究所在法兰克福）；School of Computer Engineering,University of Science and Technology (IUST)（科学技术大学（IUST）计算机工程学院）；Department of Electrical and Computer Engineering（电气与计算机工程系）；University of Waterloo（滑铁卢大学）
Alleviating Hyperparameter-Tuning Burden in SVM Classifiers for Pulmonary Nodules Diagnosis with Multi-Task Bayesian Optimization
Yau Mathematical Sciences Center Tsinghua University（姚数学科学中心清华大学）；The First Affiliated Hospital of Guangzhou Medical University（广州医科大学第一附属医院）；China State Key Laboratory of Respiratory Disease（中国呼吸疾病国家重点实验室）；Academy of Mathematics and Systems Science Chinese Academy of Sciences（数学科学学院中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Department of Thoracic Surgery and Oncology The First Affiliated Hospital of Guangzhou Medical University（胸外科与肿瘤科广州医科大学第一附属医院）
