arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.04594cs.CRcs.AIcs.LG
收藏

FedGeo:基于联邦学习的隐私保护用户下一位置预测

FedGeo: Privacy-Preserving User Next Location Prediction with Federated Learning

SK Telecom(SK电讯);KAIST(韩国科学技术院);NAVER

Chung Park, Taekyoon Choi, Taesan Kim, Mincheol Cho, Junui Hong, Minsung Choi, Jaegul Choo

AI总结:

针对联邦 UNLP 中客户端移动性异质导致性能不佳的问题,本文提出 FedGeo,融合全局地理邻接先验、模型差距最小化聚合和异质客户端概率筛选,在保护隐私的同时提升预测性能。

摘要:

用户下一位置预测(User Next Location Prediction,UNLP)任务旨在根据用户的轨迹预测其接下来将前往的位置,是众多应用中不可或缺的任务。以往在单台服务器上使用大规模轨迹数据集开展的研究已在 UNLP 任务中取得显著性能。然而,在现实应用中,隐私担忧引发了法律和伦理问题,导致人类轨迹数据集被限制共享给任何其他服务器。为此,联邦学习(Federated Learning,FL)应运而生,通过协同训练多个客户端(即用户)并随后对其进行聚合来解决个人隐私问题。尽管已有研究将 FL 用于 UNLP,但由于客户端移动性的异质性,它们仍无法取得可靠性能。为解决该问题,我们提出面向地理信息的联邦学习(Federated Learning for Geographic Information,FedGeo),这是一个专用于 UNLP 的 FL 框架,可缓解客户端移动性的异质性并保证个人隐私保护。首先,我们将先验的全局地理邻接信息纳入本地客户端模型,因为在 FL 中,每个客户端只拥有整体轨迹的异质子集,位置之间的空间相关性只能得到局部训练。我们还提出一种新的聚合方法,通过最小化客户端模型之间的差距,解决使用异质数据学习时客户端模型差异所导致的客户端漂移问题。最后,我们通过关注访问位置相对多样的客户端,以概率方式将数据极度异质的客户端排除在 FL 过程之外。我们证明 FedGeo 在 UNLP 任务中的模型性能优于其他 FL 方法。我们还使用自有客户的移动电话和 FL 智能体系统,在真实应用中验证了模型。

英文摘要:

A User Next Location Prediction (UNLP) task, which predicts the next location that a user will move to given his/her trajectory, is an indispensable task for a wide range of applications. Previous studies using large-scale trajectory datasets in a single server have achieved remarkable performance in UNLP task. However, in real-world applications, legal and ethical issues have been raised regarding privacy concerns leading to restrictions against sharing human trajectory datasets to any other server. In response, Federated Learning (FL) has emerged to address the personal privacy issue by collaboratively training multiple clients (i.e., users) and then aggregating them. While previous studies employed FL for UNLP, they are still unable to achieve reliable performance because of the heterogeneity of clients' mobility. To tackle this problem, we propose the Federated Learning for Geographic Information (FedGeo), a FL framework specialized for UNLP, which alleviates the heterogeneity of clients' mobility and guarantees personal privacy protection. Firstly, we incorporate prior global geographic adjacency information to the local client model, since the spatial correlation between locations is trained partially in each client who has only a heterogeneous subset of the overall trajectories in FL. We also introduce a novel aggregation method that minimizes the gap between client models to solve the problem of client drift caused by differences between client models when learning with their heterogeneous data. Lastly, we probabilistically exclude clients with extremely heterogeneous data from the FL process by focusing on clients who visit relatively diverse locations. We show that FedGeo is superior to other FL methods for model performance in UNLP task. We also validated our model in a real-world application using our own customers' mobile phones and the FL agent system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑