Hyperparameter tuning is critical to the success of federated learning applications. Unfortunately, appropriately selecting hyperparameters is challenging in federated networks. Issues of scale, privacy, and heterogeneity introduce noise in the tuning process and make it difficult to evaluate the performance of various hyperparameters. In this work, we perform the first systematic study on the effect of noisy evaluation in federated hyperparameter tuning. We first identify and rigorously explore key sources of noise, including client subsampling, data and systems heterogeneity, and data privacy. Surprisingly, our results indicate that even small amounts of noise can significantly impact tuning methods-reducing the performance of state-of-the-art approaches to that of naive baselines. To address noisy evaluation in such scenarios, we propose a simple and effective approach that leverages public proxy data to boost the evaluation signal. Our work establishes general challenges, baselines, and best practices for future work in federated hyperparameter tuning.
Generalizable Hyperparameter Optimization for Federated Learning on Non-IID Cancer Images
Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil（精确与技术科学研究所，弗拉维亚联邦大学-UFV，里奥帕拉纳伊巴-巴西）；Department of Computing, Federal University of São Carlos, São Carlos-SP, Brazil（计算系，圣卡洛斯联邦大学，圣卡洛斯-巴西）
Revisit the Stability of Vanilla Federated Learning Under Diverse Conditions
School of Electrical Engineering, KAIST（韩国科学技术院电气工程学院）；Department of Applied AI, Hansung University（韩星大学应用人工智能系）；Data Center and AI Group, Intel Corporation（英特尔公司数据中心与人工智能集团）
FedNoiL: A Simple Two-Level Sampling Method for Federated Learning with Noisy Labels
Australian Artificial Intelligence Institute, University of Technology Sydney（悉尼科技大学澳大利亚人工智能研究所）；University of Washington, Seattle（西雅图华盛顿大学）；University of Maryland, College Park（马里兰大学帕克分校）；Hong Kong Baptist University（香港浸会大学）
Local K-Similarity Constraint for Federated Learning with Label Noise
NAAMII, Nepal Applied Mathematics and Informatics Institute for Research（NAAMII尼泊尔应用数学与信息学研究所）；Rochester Institute of Technology（罗切斯特技术研究所）；West Virginia University（西弗吉尼亚大学）；University of Lausanne（洛桑大学）；Ulsan National Institute of Science & Technology（釜山国家科学与技术研究所）；University of Aberdeen（阿伯丁大学）
Learning Cautiously in Federated Learning with Noisy and Heterogeneous Clients
The Future Network of Intelligence Institute（未来网络智能研究院）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Zhejiang University（浙江大学）；Peng Cheng Laboratory（鹏城实验室）
FedRG: Unleashing the Representation Geometry for Federated Learning with Noisy Clients
Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；TMLR Group, Hong Kong Baptist University（香港浸会大学TMLR组）；Beihang University（北京航空航天大学）；The Hong Kong University of Science and Technology（香港科技大学）
Learning Locally, Revising Globally: Global Reviser for Federated Learning with Noisy Labels
College of Computer Science, Sichuan University, Chengdu, China（四川大学计算机学院，中国成都）；Engineering Research Center of Machine Learning（机器学习工程研究中心）；University of Sydney, Sydney, Australia（悉尼大学，澳大利亚悉尼）；Southeast University, Nanjing, China（东南大学，中国南京）
FedCova: Robust Federated Covariance Learning Against Noisy Labels
Department of Information Engineering（信息工程系）；The Chinese University of Hong Kong（香港中文大学）；National Key Laboratory on Wireless Communications（无线通信国家重点实验室）；University of Electronic Science and Technology of China（电子科学与技术大学）
Robust Federated Learning with Confidence-Weighted Filtering and GAN-Based Completion under Noisy and Incomplete Data
Computer Engineering Department, İstanbul Commerce University（伊斯坦布尔商业大学计算机工程系）；Turkcell Teknoloji（Turkcell技术公司）；Grid Communications and Security Group, Electrification and Energy Infrastructures Division, Oak Ridge National Laboratory（橡树岭国家实验室电网安全与能源基础设施部门）
针对联邦学习中的噪声标签、类别缺失与不均衡问题，提出结合自适应噪声清洗、条件 GAN 合成补全和鲁棒训练的隐私保护框架，并在 MNIST 与 Fashion-MNIST 上验证其性能提升。
Robust Federated Learning with Noisy Communication
University of Science and Technology of China（中国科学技术大学）；Dalian University of Technology（大连理工大学）；Southeast University（东南大学）；University of Warwick（华威大学）；Carleton University（卡尔顿大学）
Tackling Noisy Clients in Federated Learning with End-to-end Label Correction
Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）
Automated Federated Learning in Mobile Edge Networks -- Fast Adaptation and Convergence
Singapore University of Design and Technology（新加坡科技设计大学）；East China Normal University（华东师范大学）；University of Electronic Science and Technology of China（电子科技大学）；Beihang University（北京航空航天大学）
When to Stop Federated Learning: Zero-Shot Generation of Synthetic Validation Data with Generative AI for Early Stopping
Institute of Information & Communications Technology Planning & Evaluation (IITP)-ITRC (Information Technology Research Center)（信息与通信技术规划与评估机构（IITP）-ITRC（信息技术研究中心））；Institute of Science Tokyo（东京科学研究所）
FedUAF: Uncertainty-Aware Fusion with Reliability-Guided Aggregation for Multimodal Federated Sentiment Analysis
Shanghai University（上海大学）；North China Electric Power University（华北电力大学）；Université de Technologie de Compiègne（法国图卢兹国立理工学院）；Nanyang Technological University（南洋理工大学）；City University of Hong Kong（香港城市大学）；Macquarie University（麦考瑞大学）
