In this paper, we first give an introduction to the theoretical basis of the privacy-utility equilibrium in federated learning based on Bayesian privacy definitions and total variation distance privacy definitions. We then present the \textit{Learn-to-Distort-Data} framework, which provides a principled approach to navigate the privacy-utility equilibrium by explicitly modeling the distortion introduced by the privacy-preserving mechanism as a learnable variable and optimizing it jointly with the model parameters. We demonstrate the applicability of our framework to a variety of privacy-preserving mechanisms on the basis of data distortion and highlight its connections to related areas such as adversarial training, input robustness, and unlearnable examples. These connections enable leveraging techniques from these areas to design effective algorithms for privacy-utility equilibrium in federated learning under the \textit{Learn-to-Distort-Data} framework.
Federated learning is an emerging privacy-preserving AI technique where clients (i.e., organisations or devices) train models locally and formulate a global model based on the local model updates without transferring local data externally. However, federated learning systems struggle to achieve trustworthiness and embody responsible AI principles. In particular, federated learning systems face accountability and fairness challenges due to multi-stakeholder involvement and heterogeneity in client data distribution. To enhance the accountability and fairness of federated learning systems, we pre…
The Chinese University of Hong Kong（香港中文大学）；University of Electronic Science and Technology of China（电子科技大学）；Peng Cheng Lab（鹏城实验室）；Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））
Trustworthy artificial intelligence (AI) technology has revolutionized daily life and greatly benefited human society. Among various AI technologies, Federated Learning (FL) stands out as a promising solution for diverse real-world scenarios, ranging from risk evaluation systems in finance to cutting-edge technologies like drug discovery in life sciences. However, challenges around data isolation and privacy threaten the trustworthiness of FL systems. Adversarial attacks against data privacy, learning algorithm stability, and system confidentiality are particularly concerning in the context of…
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications（网络与交换技术国家重点实验室，北京邮电大学）；School of Computer Science and Engineering, Nanyang Technological University（南洋理工大学计算机科学与工程学院）；The Future Network of Intelligence Institute, The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳）未来智联网络研究院）；School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳）理工学院）
Trustworthy Blockchain-based Federated Learning for Electronic Health Records: Securing Participant Identity with Decentralized Identifiers and Verifiable Credentials
Federal Institute of Education, Science, and Technology of Rio Grande do Norte (IFRN)（里约格兰德北教育科学和技术联邦学院）
Enabling Trustworthy Federated Learning in Industrial IoT: Bridging the Gap Between Interpretability and Robustness
Mepco Schlenk Engineering College（梅普科施伦克工程学院）；Fordham University（福特汉姆大学）；University of South Florida（南佛罗里达大学）；Hung Yen University of Technology and Education（兴安工业大学）；Royal Military College of Canada（加拿大皇家军事学院）
Shanghai Jiao Tong University（上海交通大学）；Hangzhou Normal University（杭州师范大学）；Shanghai Normal University（上海师范大学）
Federated learning (FL) provides an emerging approach for collaboratively training semantic encoder/decoder models of semantic communication systems, without private user data leaving the devices. Most existing studies on trustworthy FL aim to eliminate data poisoning threats that are produced by malicious clients, but in many cases, eliminating model poisoning attacks brought by fake servers is also an important objective. In this paper, a certificateless authentication-based trustworthy federated learning (CATFL) framework is proposed, which mutually authenticates the identity of clients and…
A Trustworthy AIoT-enabled Localization System via Federated Learning and Blockchain
School of Electrical and Electronics Engineering, Nanyang Technological University（南洋理工大学电气与电子工程学院）；Chainbase Inc.（Chainbase公司）；PublicAI Inc.（PublicAI公司）
GuardFed: A Trustworthy Federated Learning Framework Against Dual-Facet Attacks
School of Artificial Intelligence and Computer Science, Nantong University（人工智能与计算机科学学院，南通大学）；School of Electrical and Computer Engineering, The University of Sydney（电气与计算机工程学院，悉尼大学）；School of Computer Science, University of St Andrews（计算机科学学院，圣安德鲁斯大学）；Faculty of Data Science, City University of Macau（数据科学学院，澳门城市大学）；Department of Electrical and Computer Engineering, University of Alberta（电气与计算机工程学院，阿尔伯塔大学）
Université de Sherbrooke（舍布鲁克大学）；GREYC CNRS（法国国家科学研究中心灰西实验室）；ENSICAEN（法国国立卡昂高等工程师学院）；Normandie University（诺曼底大学）；University of Technology of Troyes（特鲁瓦技术大学）
Federated learning (FL) is a distributed machine learning (ML) technique that enables collaborative training in which devices perform learning using a local dataset while preserving their privacy. This technique ensures privacy, communication efficiency, and resource conservation. Despite these advantages, FL still suffers from several challenges related to reliability (i.e., unreliable participating devices in training), tractability (i.e., a large number of trained models), and anonymity. To address these issues, we propose a secure and trustworthy blockchain framework (SRB-FL) tailored to F…
FedFiTS: Fitness-Selected, Slotted Client Scheduling for Trustworthy Federated Learning in Healthcare AI
Department of Computer Science University of the Western Cape（计算机科学系，西开普敦大学）；Department of Computer Science Missouri University of Science and Technology（计算机科学系，密苏里科学与技术大学）
Blockchain-Empowered Cyber-Secure Federated Learning for Trustworthy Edge Computing
Knight Foundation School of Computing and Information Sciences, Florida International University (FIU)（佛罗里达国际大学奈特基金会计算与信息科学学院）；School of Computing, Southern Illinois University（南伊利诺伊大学计算学院）；Enterprise and Logistics Engineering program at FIU（佛罗里达国际大学企业与物流工程项目）
A significant bottleneck in federated learning (FL) is the network communication cost of sending model updates from client devices to the central server. We present a comprehensive empirical study of the statistics of model updates in FL, as well as the role and benefits of various compression techniques. Motivated by these observations, we propose a novel method to reduce the average communication cost, which is near-optimal in many use cases, and outperforms Top-K, DRIVE, 3LC and QSGD on Stack Overflow next-word prediction, a realistic and challenging FL benchmark. This is achieved by examin…
Federated learning (FL) is an emerging paradigm for training machine learning models using possibly private data available at edge devices. The distributed operation of FL gives rise to challenges that are not encountered in centralized machine learning, including the need to preserve the privacy of the local datasets, and the communication load due to the repeated exchange of updated models. These challenges are often tackled individually via techniques that induce some distortion on the updated models, e.g., local differential privacy (LDP) mechanisms and lossy compression. In this work we p…
TrustFed: Enabling Trustworthy Medical AI under Data Privacy Constraints
Department of Applied Mechanics（应用力学系）；Indian Institute of Technology Delhi（印度理工学院德里）；Grainger College of Engineering（工程学院）；Nuclear, Plasma & Radiological Engineering Department（核物理与辐射工程系）；National Center for Supercomputing Applications（国家超级计算应用中心）；Yardi School of Artificial Intelligence (ScAI)（Yardi人工智能学院（ScAI））；University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
McMaster University（麦克马斯特大学）；National Yang-Ming Chiao-Tung University（国立阳明交通大学）；University of Toronto（多伦多大学）
In federated learning (FL), the communication constraint between the remote learners and the Parameter Server (PS) is a crucial bottleneck. For this reason, model updates must be compressed so as to minimize the loss in accuracy resulting from the communication constraint. This paper proposes ``\emph{${\bf M}$-magnitude weighted $L_{\bf 2}$ distortion + $\bf 2$ degrees of freedom''} (M22) algorithm, a rate-distortion inspired approach to gradient compression for federated training of deep neural networks (DNNs). In particular, we propose a family of distortion measures between the original gra…
Sejong University（世宗大学）；Pusan National University（釜山国立大学）
Recently, a considerable amount of works have been made to tackle the communication burden in federated learning (FL) (e.g., model quantization, data sparsification, and model compression). However, the existing methods, that boost the communication efficiency in FL, result in a considerable trade-off between communication efficiency and global convergence rate. We formulate an optimization problem for compression-aided FL, which captures the relationship between the distortion rate, number of participating IoT devices, and convergence rate. Following that, the objective function is to minimiz…
Theoretically Principled Federated Learning for Balancing Privacy and Utility
Huazhong University of Science and Technology（华中科技大学）；Tsinghua University（清华大学）；Peng Cheng Laboratory（鹏城实验室）；WeBank（微众银行）；The Hong Kong Polytechnic University（香港理工大学）
Federated Bayesian learning offers a principled framework for the definition of collaborative training algorithms that are able to quantify epistemic uncertainty and to produce trustworthy decisions. Upon the completion of collaborative training, an agent may decide to exercise her legal "right to be forgotten", which calls for her contribution to the jointly trained model to be deleted and discarded. This paper studies federated learning and unlearning in a decentralized network within a Bayesian framework. It specifically develops federated variational inference (VI) solutions based on the d…
Federated Learning (FL) enables collaborative training among mutually distrusting parties. Model updates, rather than training data, are concentrated and fused in a central aggregation server. A key security challenge in FL is that an untrustworthy or compromised aggregation process might lead to unforeseeable information leakage. This challenge is especially acute due to recently demonstrated attacks that have reconstructed large fractions of training data from ostensibly "sanitized" model updates. In this paper, we introduce TRUDA, a new cross-silo FL system, employing a trustworthy and dece…
Privacy, Robustness, and Fairness Trade-offs in Federated Intrusion Detection: Geometric Indistinguishability at the Aggregation Interface
Bangladesh University of Business and Technology (BUBT)（孟加拉国商业与技术大学（BUBT））；Jagannath University（贾格纳特大学）；University of New South Wales (UNSW)（新南威尔士大学（UNSW））
Enhancing Mutual Trustworthiness in Federated Learning for Data-Rich Smart Cities
Mohammad Bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Polytechnique Montréal（蒙特利尔理工学院）；Lebanese American University（黎巴嫩美国大学）；Khalifa University（哈利法大学）；New York University（纽约大学）；Technology Innovation Institute (TII)（技术创新研究所）
Secure Multi-Modal Data Fusion in Federated Digital Health Systems via MCP
School of Information, Computer, and Communication Technology（信息、计算机与通信技术学院）；Sirindhorn International Institute of Technology, Thammasat University（泰国朱拉安吞国际技术学院，泰国 Thammasat 大学）
Adaptive Federated Few-Shot Rare-Disease Diagnosis with Energy-Aware Secure Aggregation
School of Information, Computer, and Communication Technology（信息、计算机与通信技术学院）；Sirindhorn International Institute of Technology, Thammasat University（泰国朱拉隆功大学国际技术学院）
Zhejiang University（浙江大学）；Fudan University（复旦大学）；University of Manchester（曼彻斯特大学）；UIUC（伊利诺伊大学厄巴纳-香槟分校）
Federated learning (FL) is a collaborative learning paradigm where participants jointly train a powerful model without sharing their private data. One desirable property for FL is the implementation of the right to be forgotten (RTBF), i.e., a leaving participant has the right to request to delete its private data from the global model. However, unlearning itself may not be enough to implement RTBF unless the unlearning effect can be independently verified, an important aspect that has been overlooked in the current literature. In this paper, we prompt the concept of verifiable federated unlea…
MedFedPure: A Medical Federated Framework with MAE-based Detection and Diffusion Purification for Inference-Time Attacks
School of Electrical and Computer Engineering（电气与计算机工程学院）；Max Planck Institute for Brain Research（马克斯·普朗克脑研究所在法兰克福）；School of Computer Engineering,University of Science and Technology (IUST)（科学技术大学（IUST）计算机工程学院）；Department of Electrical and Computer Engineering（电气与计算机工程系）；University of Waterloo（滑铁卢大学）
Robust Federated Learning under Adversarial Attacks via Loss-Based Client Clustering
School of Electrical and Computer Engineering, National Technical University of Athens（电气与计算机工程学院，国家技术大学雅典）；Faculty of Sciences, University of Novi Sad（科学学院，诺维萨德大学）
Federated learning provides a promising paradigm for collecting machine learning models from distributed data sources without compromising users' data privacy. The success of a credible federated learning system builds on the assumption that the decentralized and self-interested users will be willing to participate to contribute their local models in a trustworthy way. However, without proper incentives, users might simply opt out the contribution cycle, or will be mis-incentivized to contribute spam/false information. This paper introduces solutions to incentivize truthful reporting of a loca…
Nanyang Technological University（南洋理工大学）；Alibaba-NTU Singapore Joint Research Institute（阿里巴巴-南洋理工大学新加坡联合研究院）；Alibaba Group（阿里巴巴集团）；Shandong University（山东大学）；Joint SDU-NTU Centre for Artificial Intelligence Research（山东大学-南洋理工大学人工智能联合研究院）；Hong Kong University of Science and Technology（香港科技大学）；WeBank（微众银行）
In parallel with the rapid adoption of Artificial Intelligence (AI) empowered by advances in AI research, there have been growing awareness and concerns of data privacy. Recent significant developments in the data regulation landscape have prompted a seismic shift in interest towards privacy-preserving AI. This has contributed to the popularity of Federated Learning (FL), the leading paradigm for the training of machine learning models on data silos in a privacy-preserving manner. In this survey, we explore the domain of Personalized FL (PFL) to address the fundamental challenges of FL on hete…
University of Applied Science Würzburg-Schweinfurt（维尔茨堡-施韦因富特应用科学大学）；CEREMADE University Paris Dauphine PSL（巴黎多芬大学PSL CEREMADE）
In recent years the applications of machine learning models have increased rapidly, due to the large amount of available data and technological progress.While some domains like web analysis can benefit from this with only minor restrictions, other fields like in medicine with patient data are strongerregulated. In particular \emph{data privacy} plays an important role as recently highlighted by the trustworthy AI initiative of the EU or general privacy regulations in legislation. Another major challenge is, that the required training \emph{data is} often \emph{distributed} in terms of features…
University of Pisa（比萨大学）；Information Technology for Market Leadership（市场领导力信息技术公司）；Institute of Information Science and Technologies (ISTI), CNR（意大利国家研究委员会信息科学与技术研究所）；AVL List GmbH（AVL李斯特有限公司）；Graz University of Technology（格拉茨工业大学）；Harokopio University of Athens（雅典哈罗科皮奥大学）；Infineon Technologies AG（英飞凌科技股份公司）；Marelli Europe S.p.A（玛涅蒂玛瑞利欧洲股份公司）
This paper discusses the perspective of the H2020 TEACHING project on the next generation of autonomous applications running in a distributed and highly heterogeneous environment comprising both virtual and physical resources spanning the edge-cloud continuum. TEACHING puts forward a human-centred vision leveraging the physiological, emotional, and cognitive state of the users as a driver for the adaptation and optimization of the autonomous applications. It does so by building a distributed, embedded and federated learning system complemented by methods and tools to enforce its dependability,…
Data Valuation and Selection in a Federated Model Marketplace
IORA National University of Singapore（国际研究机构国立新加坡大学）；NUS Research Institution（国立新加坡大学研究机构）；Department of ECE（电子工程系）；Virginia Tech（弗吉尼亚理工大学）；Business School（商学院）
