arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.01828cs.NIcs.LG
收藏

基于年龄的设备选择与传输功率优化在空中联邦学习中

Age-Based Device Selection and Transmit Power Optimization in Over-the-Air Federated Learning

School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);University of Jyväskylä(于韦斯屈莱大学);Center for Intelligent Networking and Communications (CINC), University of Electronic Science and Technology of China(电子科技大学智能网络与通信中心)

Jingyuan Liu, Zheng Chang, Ying-Chang Liang

AI总结:

本文提出基于信息年龄的设备选择与传输功率优化方法,以提升空中联邦学习的模型性能和系统效率。

摘要:

最近,空中联邦学习(FL)因其提升通信效率的能力而引起了广泛关注。然而,空中FL的性能往往受到设备选择策略和信号聚合误差的限制。特别是,在FL中忽视滞后设备会导致模型更新的公平性下降,并放大全局模型对某些设备数据的偏见,最终影响整体系统性能。为了解决这个问题,我们提出了一种联合设备选择和传输功率优化框架,以确保滞后设备的适当参与,保持高效的训练性能,并保证及时更新。首先,我们进行理论分析,量化在基于信息年龄(AoI)的设备选择下的空中FL收敛上界。我们的分析进一步揭示了所选设备数量和信号聚合误差对收敛上界有显著影响。为了最小化预期加权总信息年龄,我们使用Lyapunov优化计算每个通信轮次的设备优先级,并通过贪心算法选择最高优先级的设备。然后,我们为所选设备制定并解决传输功率和归一化因子优化问题,以最小化时间平均均方误差(MSE)。实验结果表明,我们提出的方法具有两个显著优势:(1)相比基线方法,它减少了MSE并提高了模型性能;(2)它在保持满意及时性的同时,在公平性和训练效率之间取得平衡,确保稳定的模型性能。

英文摘要:

Recently, over-the-air federated learning (FL) has attracted significant attention for its ability to enhance communication efficiency. However, the performance of over-the-air FL is often constrained by device selection strategies and signal aggregation errors. In particular, neglecting straggler devices in FL can lead to a decline in the fairness of model updates and amplify the global model's bias toward certain devices' data, ultimately impacting the overall system performance. To address this issue, we propose a joint device selection and transmit power optimization framework that ensures the appropriate participation of straggler devices, maintains efficient training performance, and guarantees timely updates. First, we conduct a theoretical analysis to quantify the convergence upper bound of over-the-air FL under age-of-information (AoI)-based device selection. Our analysis further reveals that both the number of selected devices and the signal aggregation errors significantly influence the convergence upper bound. To minimize the expected weighted sum peak age of information, we calculate device priorities for each communication round using Lyapunov optimization and select the highest-priority devices via a greedy algorithm. Then, we formulate and solve a transmit power and normalizing factor optimization problem for selected devices to minimize the time-average mean squared error (MSE). Experimental results demonstrate that our proposed method offers two significant advantages: (1) it reduces MSE and improves model performance compared to baseline methods, and (2) it strikes a balance between fairness and training efficiency while maintaining satisfactory timeliness, ensuring stable model performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑