Fundamental Limits of Hierarchical Secure Aggregation with Cyclic User Association
Technical University of Berlin(柏林工业大学);Guangxi University(广西大学);Huazhong University of Science and Technology(华中科技大学);University of North Texas(北德克萨斯大学);University of Florida(佛罗里达大学)
Xiang Zhang, Zhou Li, Kai Wan, Hua Sun, Mingyue Ji, Giuseppe Caire
备注:
Manuscript submitted to IEEE Transactions on Information Theory for review
Secure aggregation is motivated by federated learning (FL) where a cloud server aims to compute an {aggregated} model (i.e., weights of deep neural networks) of the locally-trained models of numerous clients {through an iterative communication process}, while adhering to data security requirements. Hierarchical secure aggregation (HSA) extends this concept to a three-layer hierarchical network, where clustered users communicate with the server through an intermediate layer of relays. In HSA, beyond conventional server security, relay security is also enforced to ensure that the relays remain oblivious to the users' inputs (an abstraction of the local models in FL). {Existing studies on HSA that jointly consider communication and secret key generation efficiency typically assume that each user is associated with only one relay, limiting opportunities for coding across inter-cluster users to achieve efficient communication and key generation.} In this paper, we consider HSA with a cyclic association pattern where each user is connected to $B$ consecutive relays in a wrap-around manner. We propose an efficient aggregation scheme which includes a message design for the inputs inspired by gradient coding-a well-known technique for efficient communication in distributed computing-along with a highly non-trivial security key design.
The Capacity of Information-Theoretic Secure Aggregation in Federated Learning
Information Coding and Transmission (ICT) Key Laboratory of Sichuan Province, Southwest Jiaotong University(四川省信息编码与传输(ICT)重点实验室,西南交通大学);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院)
Secure Embedding Aggregation for Federated Representation Learning
The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Lehigh University(理海大学)
Optimal Communication and Key Rate Region for Hierarchical Secure Aggregation with User Collusion
Technical University of Berlin(柏林工业大学);Huazhong University of Science and Technology(华中科技大学);University of North Texas(北德克萨斯大学);University of Exeter(埃克塞特大学)
LightSecAgg: a Lightweight and Versatile Design for Secure Aggregation in Federated Learning
University of Southern California(南加利福尼亚大学);Mediatek Inc.(联发科技股份有限公司);The Hong Kong University of Science and Technology(香港科技大学);Princeton University(普林斯顿大学);University of California at Riverside(加州大学河滨分校)
SwiftAgg: Communication-Efficient and Dropout-Resistant Secure Aggregation for Federated Learning with Worst-Case Security Guarantees
Sharif University of Technology(谢里夫理工大学);Technische Universität Berlin(柏林工业大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学)
Information-Theoretic Secure Aggregation over Regular Graphs
Technical University of Berlin(柏林工业大学);Guangxi University(广西大学);Huazhong University of Science and Technology(华中科技大学);University of North Texas(北德克萨斯大学);University of Florida(佛罗里达大学)
Information-Theoretic Decentralized Secure Aggregation with Passive Collusion Resilience
Department of Electrical Engineering and Computer Science, Technical University of Berlin(技术大学柏林电气工程与计算机科学系);Guangxi Key Laboratory of Multimedia Communications and Network Technology, Guangxi University(广西多媒体通信与网络技术重点实验室,广西大学);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院);School of Electrical Engineering and Telecommunications, University of New South Wales(新南威尔士大学电子工程与电信学院)
Optimal Rate Region for Multi-server Secure Aggregation with User Collusion
Guangxi University(广西大学);Technical University of Berlin(柏林工业大学);Huazhong University of Science and Technology(华中科技大学);University of North Texas(北德克萨斯大学);University of Florida(佛罗里达大学)
Perfectly-Private Analog Secure Aggregation in Federated Learning
Department of Electrical Engineering, Chalmers University of Technology, Sweden(瑞典查尔姆斯理工大学电子工程系);Department of Mathematics and Systems Analysis, Aalto University, Finland(芬兰阿尔托大学数学与系统分析系)
On hierarchical secure aggregation against relay and user collusion
Institute of Mathematics and Interdisciplinary Sciences, Xidian University(西安电子科技大学数学与交叉科学研究院);School of Mathematical Sciences, Capital Normal University(首都师范大学数学科学学院);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院)
ScionFL: Efficient and Robust Secure Quantized Aggregation
VMware Research Group(威睿研究集团);Technical University of Darmstadt(达姆施塔特工业大学);Aptos Labs(Aptos实验室);Bar-Ilan University(巴伊兰大学);Technology Innovation Institute(技术创新研究院);DFINITY Foundation(DFINITY基金会);Royal Holloway, University of London(伦敦大学皇家霍洛威学院)
ByzSecAgg: A Byzantine-Resistant Secure Aggregation Scheme for Federated Learning Based on Coded Computing and Vector Commitment
Department of Electrical Engineering and Computer Science, Technische Universität Berlin(电气工程与计算机科学系,柏林技术大学);Department of Electrical and Computer Engineering, University of Minnesota Twin Cities(电气与计算机工程系,明尼苏达大学双城分校)
Hierarchical Secure Aggregation with Heterogeneous Security Constraints and Arbitrary User Collusion
Guangxi Key Laboratory of Multimedia Communications and Network Technology(广西多媒体通信与网络技术重点实验室);Guangxi University(广西大学);Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);Technical University of Berlin(柏林技术大学);School of Cyber Science and Engineering(网络安全科学与工程学院);Nanjing University of Science and Technology(南京理工大学)
Information-Theoretic Secure Aggregation in Decentralized Networks
Technical University of Berlin(柏林工业大学);Guangxi University(广西大学);Huazhong University of Science and Technology(华中科技大学);the University of New South Wales(新南威尔士大学)
SwiftAgg+: Achieving Asymptotically Optimal Communication Loads in Secure Aggregation for Federated Learning
Technische Universität Berlin(柏林工业大学);Sharif University of Technology(谢里夫理工大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学)