With strict protections and regulations of data privacy and security, conventional machine learning based on centralized datasets is confronted with significant challenges, making artificial intelligence (AI) impractical in many mission-critical and data-sensitive scenarios, such as finance, government, and health. In the meantime, tremendous datasets are scattered in isolated silos in various industries, organizations, different units of an organization, or different branches of an international organization. These valuable data resources are well underused. To advance AI theories and applications, we propose a comprehensive framework (called Knowledge Federation - KF) to address these challenges by enabling AI while preserving data privacy and ownership. Beyond the concepts of federated learning and secure multi-party computation, KF consists of four levels of federation: (1) information level, low-level statistics and computation of data, meeting the requirements of simple queries, searching and simplistic operators; (2) model level, supporting training, learning, and inference; (3) cognition level, enabling abstract feature representation at various levels of abstractions and contexts; (4) knowledge level, fusing knowledge discovery, representation, and reasoning. We further clarify the relationship and differentiation between knowledge federation and other related research areas. We have developed a reference implementation of KF, called iBond Platform, to offer a production-quality KF platform to enable industrial applications in finance, insurance et al. The iBond platform will also help establish the KF community and a comprehensive ecosystem and usher in a novel paradigm shift towards secure, privacy-preserving and responsible AI. As far as we know, knowledge federation is the first hierarchical and unified framework for secure multi-party computing and learning.
Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving
Department of Electrical Engineering and Computer Science, University of Stavanger(电子工程与计算机科学系,斯塔万格大学);Department of Data Science, The Catholic University of Korea(数据科学系,韩国天主大学)
Task-Agnostic Federation over Decentralized Data: Research Landscape and Visions
Department of Computer Science, College of Information Science and Technology, Jinan University(计算机科学系,信息科学与技术学院,暨南大学);Department of Computer Science, University of Warwick(计算机科学系,沃里克大学);School of Electronic Engineering and Computer Science, Queen Mary University of London(电子工程与计算机科学学院,伦敦女王玛丽大学);Department of Electronic Business and the Institute of Digital Business & Intelligent Logistics, South China University of Technology(电子商务系及数字商务与智能物流研究所,华南理工大学);College of Computer Science and Software Engineering and the Shenzhen Institute of Computing Sciences, Shenzhen University(计算机科学与软件工程学院及深圳计算科学研究所,深圳大学);Department of Computer Science, State University of New York(计算机科学系,纽约州立大学)
H-FLTN: A Privacy-Preserving Hierarchical Framework for Electric Vehicle Spatio-Temporal Charge Prediction
School of Computer Science, Queensland University of Technology(昆士兰科技大学计算机科学学院);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织数据61部);Cyber Security Cooperative Research Centre(网络安全合作研究中心)
Towards Family-Grouped Hierarchical Federated Learning on Sub-5KB Models: A Feasibility Study of Privacy-Preserving ECG Monitoring for Ultra-Resource-Constrained Wearables
A Survey of Personalized Federated Foundation Models for Privacy-Preserving Recommendation
Australian Artificial Intelligence Institute, University of Technology Sydney(澳大利亚人工智能研究所,悉尼技术大学);College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(香港理工大学数据科学与人工智能系)
A Federated Parameter Aggregation Method for Node Classification Tasks with Different Graph Network Structures
Institute of Cyberspace Security, Zhejiang University of Technology(浙江工业大学网络空间安全研究院);Binjiang Cyberspace Security Institute of ZJUT(浙江工业大学滨江网络空间安全研究院);College of Information Engineering, Zhejiang University of Technology(浙江工业大学信息工程学院)
Social-Aware Clustered Federated Learning with Customized Privacy Preservation
School of Cyber Science and Engineering, Xi’an Jiaotong University(西安交通大学网络空间安全学院);Institute of Science and Engineering, Kanazawa University(金泽大学科学与工程学院);School of Computer Science, University of Technology Sydney(悉尼科技大学计算机科学学院)
PriPHiT: Privacy-Preserving Hierarchical Training of Deep Neural Networks
Signal Processing Laboratory (LTS4), École Polytechnique Fédérale de Lausanne (EPFL)(瑞士联邦理工学院洛桑校区信号处理实验室);Centre Suisse d’Electronique et de Microtechnique (CSEM)(瑞士电子与微技术中心)
ELSA: Efficient LLM-Centric Split Aggregation for Privacy-Aware Hierarchical Federated Learning over the Network Edge
School of Informatics, Xiamen University(厦门大学信息学院);National University of Singapore(新加坡国立大学);Teleinfo iF-Labs, China Academy of Information and Communications Technology(Teleinfo iF-Labs,中国信息通信技术研究院);Department of Electrical Engineering, University at Buffalo-SUNY(电气工程系,布法罗大学-纽约州立大学)
Topology-Aware Differential Privacy in Hierarchical Federated Learning
Quantum Cloud Computing and Distributed Systems (qCLOUDS) Lab, School of Computing and Information Systems, The University of Melbourne(量子云计算与分布式系统实验室,计算与信息系统学院,墨尔本大学)