arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.07669eess.SP
收藏

走向安全和私有的空中联合学习

Toward Secure and Private Over-the-Air Federated Learning

Na Yan, Kezhi Wang, Kangda Zhi, Cunhua Pan, Kok Keong Chai, H. Vincent Poor

摘要:

本文研究了一种新的安全和私有的空中联邦学习(SP-OTA-FL)框架,其中使用噪声来保护数据隐私和系统安全。具体地说,用户数据的隐私泄漏和系统的安全级别分别衡量差分隐私(DP)和均方误差安全(MSE-安全)。为了减轻噪声对学习精度的影响,我们提出了一种信道加权后处理(CWPP)机制,该机制为信道条件较差的设备的梯度分配较小的权重。此外,使用CWPP可以避免在对齐的空中联合学习(OTA-FL)中具有最差信道条件的设备限制整个系统的信噪比(SNR)的问题。我们从理论上分析了噪声对隐私和安全保护的影响,并通过收敛性分析说明了噪声对学习性能的不利影响。基于这些分析结果,我们提出了在不同的信道噪声情况下,考虑隐私和安全保护的设备调度策略。特别是,我们制定了一个整数非线性分式规划问题,旨在最大限度地减少噪声对学习过程的负面影响。当模型为高维时,得到了优化问题的封闭解。对于一般情况,我们提出了一个安全和私有的算法(SPA)的基础上的分支定界(BnB)方法,它可以获得一个最佳的解决方案,具有较低的复杂度。通过仿真验证了所提出的CWPP机制和设备选择策略的有效性。

英文摘要:

In this paper, a novel secure and private over-the-air federated learning (SP-OTA-FL) framework is studied where noise is employed to protect data privacy and system security. Specifically, the privacy leakage of user data and the security level of the system are measured by differential privacy (DP) and mean square error security (MSE-security), respectively. To mitigate the impact of noise on learning accuracy, we propose a channel-weighted post-processing (CWPP) mechanism, which assigns a smaller weight to the gradient of the device with poor channel conditions. Furthermore, employing CWPP can avoid the issue that the signal-to-noise ratio (SNR) of the overall system is limited by the device with the worst channel condition in aligned over-the-air federated learning (OTA-FL). We theoretically analyze the effect of noise on privacy and security protection and also illustrate the adverse impact of noise on learning performance by conducting convergence analysis. Based on these analytical results, we propose device scheduling policies considering privacy and security protection in different cases of channel noise. In particular, we formulate an integer nonlinear fractional programming problem aiming to minimize the negative impact of noise on the learning process. We obtain the closed-form solution to the optimization problem when the model is with high dimension. For the general case, we propose a secure and private algorithm (SPA) based on the branch-and-bound (BnB) method, which can obtain an optimal solution with low complexity. The effectiveness of the proposed CWPP mechanism and the policies for device selection are validated through simulations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑