arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.05271cs.DCcs.LGmath.OCstat.ML
收藏

资源受限边缘计算系统中的自适应联邦学习

Adaptive Federated Learning in Resource Constrained Edge Computing Systems

IBM T. J. Watson Research Center(IBM托马斯·J·沃森研究中心);Imperial College London(帝国理工学院);Pennsylvania State University(宾夕法尼亚州立大学);Army Research Laboratory(陆军研究实验室)

Shiqiang Wang, Tiffany Tuor, Theodoros Salonidis, Kin K. Leung, Christian Makaya, Ting He, Kevin Chan

摘要:

包括物联网(IoT)、社交网络和众包在内的新兴技术和应用在网络边缘产生大量数据。机器学习模型通常从收集的数据中构建,以实现对未来事件的检测、分类和预测。由于带宽、存储和隐私问题,将所有数据发送到一个集中位置通常是不切实际的。在本文中,我们考虑从分布在多个边缘节点的数据中学习模型参数的问题,而无需将原始数据发送到集中的地方。我们的重点是一类通用的机器学习模型,使用基于梯度下降的方法进行训练。从理论上分析了分布式梯度下降算法的收敛界,并在此基础上提出了一种控制算法,该算法在给定的资源预算下确定局部更新和全局参数聚合之间的最佳折衷,以最小化损失函数.该算法的性能进行了评估,通过广泛的实验与真实的数据集,无论是在一个网络化的原型系统,并在一个更大规模的模拟环境。实验结果表明,我们提出的方法执行接近最佳的各种机器学习模型和不同的数据分布。

英文摘要:

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best trade-off between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑