arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.10894cs.DC
收藏

无线分布式边缘学习:我们需要多少边缘设备?

Wireless Distributed Edge Learning: How Many Edge Devices Do We Need?

Jaeyoung Song, Marios Kountouris

摘要:

我们考虑无线边缘的分布式机器学习,其中参数服务器在多个无线边缘设备的帮助下构建全局模型,这些设备在本地数据集分区上执行计算。边缘设备使用固定速率和正交多址接入通过易出错的无线信道将其计算结果(当前全局模型的更新)发送到服务器。在传输错误的情况下,未递送的分组被重传,直到在接收器处被成功解码。利用分布式系统中计算和通信之间的基本权衡,我们的目标是推导出需要多少边缘设备来最小化平均完成时间,同时保证收敛。我们提供了上界和下界的平均完成,我们找到了一个必要条件,在两个渐近制度,即大数据集和高精度制度添加边缘设备。在真实数据集上进行的实验和数值结果证实了我们的分析,并证实了我们的主张,即应该仔细选择边缘设备的数量,以便及时进行分布式边缘学习。

英文摘要:

We consider distributed machine learning at the wireless edge, where a parameter server builds a global model with the help of multiple wireless edge devices that perform computations on local dataset partitions. Edge devices transmit the result of their computations (updates of current global model) to the server using a fixed rate and orthogonal multiple access over an error prone wireless channel. In case of a transmission error, the undelivered packet is retransmitted until successfully decoded at the receiver. Leveraging on the fundamental tradeoff between computation and communication in distributed systems, our aim is to derive how many edge devices are needed to minimize the average completion time while guaranteeing convergence. We provide upper and lower bounds for the average completion and we find a necessary condition for adding edge devices in two asymptotic regimes, namely the large dataset and the high accuracy regime. Conducted experiments on real datasets and numerical results confirm our analysis and substantiate our claim that the number of edge devices should be carefully selected for timely distributed edge learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑