arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.00425cs.LGcs.NI
收藏

面向联邦分析的边缘辅助民主化学习

Edge-assisted Democratized Learning Towards Federated Analytics

The University of Sydney(悉尼大学);University of Houston(休斯顿大学);Kyung Hee University(庆熙大学)

Shashi Raj Pandey, Minh N. H. Nguyen, Tri Nguyen Dang, Nguyen H. Tran, Kyi Thar, Zhu Han, Choong Seon Hong

摘要:

最近对Federated Analytics(FA)的一项研究,允许对分布式数据集进行分析,它重用了联邦学习(FL)基础设施来评估整个训练设备的模型性能摘要。然而,目前的FL实现采用单服务器-多客户端架构,FA范围有限,这往往导致学习模型泛化能力差,即,处理新的/看不见的数据的能力,用于现实世界的应用。此外,一个分层FL结构与分布式计算平台展示了不相干的模型性能在不同的聚合水平。因此,我们需要设计一个比FL更强大的学习机制,(i)为FA释放一个可行的基础设施,(ii)训练具有更好泛化能力的学习模型。在这项工作中,我们采用了新的民主化学习(Dem-AI)原则和设计来实现这些目标。首先,我们展示了所提出的边缘辅助民主化学习机制(即Edge-DemLearn)的分层学习结构,作为一个实用的框架,以增强支持FA的泛化能力。其次,我们验证了Edge-DemLearn作为一种灵活的模型训练机制,通过利用分布式计算基础设施,在区域中构建分布式控制和聚合方法。分布式边缘计算服务器构建区域模型,最小化通信负载,并确保分布式数据分析应用的可扩展性。为此,我们坚持一个接近最佳的双边多对一匹配的方法来处理边缘DemLearn中的组合约束,并解决它的快速知识获取与优化的资源分配和多个服务器和设备之间的关联。在真实数据集上的大量仿真结果证明了所提方法的有效性。

英文摘要:

A recent take towards Federated Analytics (FA), which allows analytical insights of distributed datasets, reuses the Federated Learning (FL) infrastructure to evaluate the summary of model performances across the training devices. However, the current realization of FL adopts single server-multiple client architecture with limited scope for FA, which often results in learning models with poor generalization, i.e., an ability to handle new/unseen data, for real-world applications. Moreover, a hierarchical FL structure with distributed computing platforms demonstrates incoherent model performances at different aggregation levels. Therefore, we need to design a robust learning mechanism than the FL that (i) unleashes a viable infrastructure for FA and (ii) trains learning models with better generalization capability. In this work, we adopt the novel democratized learning (Dem-AI) principles and designs to meet these objectives. Firstly, we show the hierarchical learning structure of the proposed edge-assisted democratized learning mechanism, namely Edge-DemLearn, as a practical framework to empower generalization capability in support of FA. Secondly, we validate Edge-DemLearn as a flexible model training mechanism to build a distributed control and aggregation methodology in regions by leveraging the distributed computing infrastructure. The distributed edge computing servers construct regional models, minimize the communication loads, and ensure distributed data analytic application's scalability. To that end, we adhere to a near-optimal two-sided many-to-one matching approach to handle the combinatorial constraints in Edge-DemLearn and solve it for fast knowledge acquisition with optimization of resource allocation and associations between multiple servers and devices. Extensive simulation results on real datasets demonstrate the effectiveness of the proposed methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑