arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.08474cs.GT
收藏

以隐私换取效用:联邦学习中基于学习的隐私定价博弈

Trade Privacy for Utility: A Learning-Based Privacy Pricing Game in Federated Learning

Yuntao Wang, Zhou Su, Yanghe Pan, Abderrahim Benslimane, Yiliang Liu, Tom H. Luan, Ruidong Li

摘要:

为了防止在联邦学习(FL)下数据所有者(DO)之间共享梯度时的隐式隐私泄露,差分隐私(DP)及其变体已经成为一种常见的实践,以提供低开销的正式隐私保证。然而,个体DO通常倾向于注入更大的DP噪声以获得更强的隐私规定(这导致模型效用的严重退化),而策展人(即,聚集服务器)旨在最小化所添加的随机噪声的总体影响以获得令人满意的模型性能。为了解决这一矛盾的目标,我们提出了一种新的动态隐私定价(DyPP)游戏,它允许DO出售个人隐私(通过降低本地添加的DP噪声的规模)差异化的经济补偿(由策展人提供),从而提高FL模型的实用性。考虑到参与者之间的多维信息不对称(例如,DO的数据分布和隐私偏好,以及策展人的最大可负担报酬)以及他们在不同FL任务中的不同隐私信息,很难直接达到混合策略DyPP博弈的纳什均衡。另外,我们设计了一个快速的强化学习算法,具有两个层次,快速学习的最佳混合噪声节省策略的DO和最佳的混合定价策略的策展人没有先验知识的球员的私人信息。在真实数据集上的实验验证了该方案的可行性和有效性,在更快的收敛速度和提高FL模型的效用与更低的支付成本。

英文摘要:

To prevent implicit privacy disclosure in sharing gradients among data owners (DOs) under federated learning (FL), differential privacy (DP) and its variants have become a common practice to offer formal privacy guarantees with low overheads. However, individual DOs generally tend to inject larger DP noises for stronger privacy provisions (which entails severe degradation of model utility), while the curator (i.e., aggregation server) aims to minimize the overall effect of added random noises for satisfactory model performance. To address this conflicting goal, we propose a novel dynamic privacy pricing (DyPP) game which allows DOs to sell individual privacy (by lowering the scale of locally added DP noise) for differentiated economic compensations (offered by the curator), thereby enhancing FL model utility. Considering multi-dimensional information asymmetry among players (e.g., DO's data distribution and privacy preference, and curator's maximum affordable payment) as well as their varying private information in distinct FL tasks, it is hard to directly attain the Nash equilibrium of the mixed-strategy DyPP game. Alternatively, we devise a fast reinforcement learning algorithm with two layers to quickly learn the optimal mixed noise-saving strategy of DOs and the optimal mixed pricing strategy of the curator without prior knowledge of players' private information. Experiments on real datasets validate the feasibility and effectiveness of the proposed scheme in terms of faster convergence speed and enhanced FL model utility with lower payment costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑