arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.13092cs.DCcs.AI
收藏

面向设备上联邦学习:一种基于直接无环图的区块链方法

Towards On-Device Federated Learning: A Direct Acyclic Graph-based Blockchain Approach

Beijing University of Posts and Telecommunications(北京邮电大学);University of Electronic Science and Technology of China(电子科技大学)

Mingrui Cao, Long Zhang, Bin Cao

摘要:

由于联邦学习(FL)的分布式特点,全局模型的脆弱性和设备间的协调性是其实现的主要障碍。作为一种去中心化,可扩展性和安全性的解决方案,近年来在FL中利用区块链引起了人们的广泛关注。然而,为区块链设计的传统共识机制(如工作量证明(PoW))会导致极端的资源消耗,这大大降低了FL的效率,特别是当参与设备是无线和资源有限时。为了解决FL中的设备冗余和异常检测问题,同时避免区块链造成的额外资源消耗,本文介绍了一种使用基于直接无环图(DAG)的区块链系统(DAG-FL)来授权FL的框架。为此,首先从三层体系结构的角度详细介绍了DAG-FL,然后设计了运行在不同节点上的DAG-FL控制算法和DAG-FL更新算法,详细阐述了DAG-FL共识机制的运行过程。在此基础上,建立了泊松过程模型,讨论了在不同的联邦学习任务中,如何设置部署参数以保持DAG-FL的稳定性。大量的仿真和实验表明,DAG-FL可以实现更好的性能,在训练效率和模型的准确性相比,典型的现有的设备上的联邦学习系统作为基准。

英文摘要:

Due to the distributed characteristics of Federated Learning (FL), the vulnerability of global model and coordination of devices are the main obstacle. As a promising solution of decentralization, scalability and security, leveraging blockchain in FL has attracted much attention in recent years. However, the traditional consensus mechanisms designed for blockchain like Proof of Work (PoW) would cause extreme resource consumption, which reduces the efficiency of FL greatly, especially when the participating devices are wireless and resource-limited. In order to address device asynchrony and anomaly detection in FL while avoiding the extra resource consumption caused by blockchain, this paper introduces a framework for empowering FL using Direct Acyclic Graph (DAG)-based blockchain systematically (DAG-FL). Accordingly, DAG-FL is first introduced from a three-layer architecture in details, and then two algorithms DAG-FL Controlling and DAG-FL Updating are designed running on different nodes to elaborate the operation of DAG-FL consensus mechanism. After that, a Poisson process model is formulated to discuss that how to set deployment parameters to maintain DAG-FL stably in different federated learning tasks. The extensive simulations and experiments show that DAG-FL can achieve better performance in terms of training efficiency and model accuracy compared with the typical existing on-device federated learning systems as the benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑