arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2311.02130cs.LGcs.AI
收藏

面向支持NOMA的分层联邦学习的客户端编排与成本高效联合优化

Client Orchestration and Cost-Efficient Joint Optimization for NOMA-Enabled Hierarchical Federated Learning

Western University(西安大略大学);Jinan University(暨南大学);Chongqing University(重庆大学);Khalifa University(哈利法大学);University of Manchester(曼彻斯特大学)

Bibo Wu, Fang Fang, Xianbin Wang, Donghong Cai, Shu Fu, Zhiguo Ding

AI总结:

针对支持NOMA的分层联邦学习通信与能源开销瓶颈,提出基于模糊逻辑的客户端编排策略,联合优化边缘调度与资源分配,通过PDD和DDPG求解,实现性能提升与成本降低。

摘要:

分层联邦学习(HFL)相较于传统的两层联邦学习(FL)在降低网络开销和交互延迟方面展现出显著优势,同时仍能保留分布式FL客户端的数据隐私。然而,通信和能源开销仍然是制约HFL性能的瓶颈,尤其是在客户端数量急剧增长的情况下。为解决这一问题,本文提出了一种在半同步云模型聚合下支持非正交多址接入(NOMA)的HFL系统,旨在最小化每个HFL全局轮次的时间与能源总成本。具体而言,我们首先提出了一种新颖的基于模糊逻辑的客户端编排策略,该策略考虑了客户端在信道质量、数据量和模型陈旧度等多方面的异构性。随后,基于模糊的客户端-边缘关联,我们构建了一个边缘服务器调度与资源分配的联合优化问题。通过问题分解,我们首先利用惩罚对偶分解(PDD)方法推导出边缘服务器调度子问题的闭式解。接着,我们提出了一种基于深度确定性策略梯度(DDPG)的算法,用于解决时变环境下的资源分配子问题。最后,大量仿真实验表明,所提出的方案在提升HFL性能和降低总成本方面优于所考虑的基准方法。

英文摘要:

Hierarchical federated learning (HFL) shows great advantages over conventional two-layer federated learning (FL) in reducing network overhead and interaction latency while still retaining the data privacy of distributed FL clients. However, the communication and energy overhead still pose a bottleneck for HFL performance, especially as the number of clients raises dramatically. To tackle this issue, we propose a non-orthogonal multiple access (NOMA) enabled HFL system under semi-synchronous cloud model aggregation in this paper, aiming to minimize the total cost of time and energy at each HFL global round. Specifically, we first propose a novel fuzzy logic based client orchestration policy considering client heterogenerity in multiple aspects, including channel quality, data quantity and model staleness. Subsequently, given the fuzzy based client-edge association, a joint edge server scheduling and resource allocation problem is formulated. Utilizing problem decomposition, we firstly derive the closed-form solution for the edge server scheduling subproblem via the penalty dual decomposition (PDD) method. Next, a deep deterministic policy gradient (DDPG) based algorithm is proposed to tackle the resource allocation subproblem considering time-varying environments. Finally, extensive simulations demonstrate that the proposed scheme outperforms the considered benchmarks regarding HFL performance improvement and total cost reduction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑