arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.07129cs.LG
收藏

用于设备社会中的分类任务的联合和持续学习

Federated and continual learning for classification tasks in a society of devices

CiTIUS (Centro Singular de Investigación en Tecnoloxías Intelixentes)(CiTIUS(智能技术卓越研究中心));Universidade de Santiago de Compostela(圣地亚哥德孔波斯特拉大学);CITIC(CITIC(信息与通信技术研究中心));Universidade da Coruña(拉科鲁尼亚大学)

Fernando E. Casado, Dylan Lema, Roberto Iglesias, Carlos V. Regueiro, Senén Barro

摘要:

今天,我们生活在这样一个环境中,设备越来越多地相互连接和传感,几乎无处不在。近年来,深度学习已经成为从这些设备能够收集的大量数据中提取知识的流行方法。然而,集中式最先进的学习方法在面对真正的分布式问题时存在许多缺点,其中可用的信息通常是私有的,部分的,有偏见的并且随着时间的推移而不断变化。联邦学习是一种流行的框架,它允许多个分布式设备远程、协作地训练模型,并保护数据隐私。然而,目前联邦学习的建议集中在深度架构上,在许多情况下,在智能手机等非专用设备中实现是不可行的。此外,关于数据分布随时间以不可预见的方式发生变化的情况几乎没有研究,这导致了所谓的概念漂移。因此,在这项工作中,我们希望提出轻量级联合和持续共识(LFedCon2),这是一种使用轻量级传统学习器的新的联合和持续架构。我们的方法允许无动力设备(如智能手机或机器人)实时的、本地、连续、自主地从用户那里学习,而且还可以在云中全局地改进模型,结合设备中本地学习的内容。为了测试我们的建议,我们已经将其应用于智能手机用户的异构社区,以解决步行识别的问题。结果显示了LFedCon2相对于其他最先进方法的优势。

英文摘要:

Today we live in a context in which devices are increasingly interconnected and sensorized and are almost ubiquitous. Deep learning has become in recent years a popular way to extract knowledge from the huge amount of data that these devices are able to collect. Nevertheless, centralized state-of-the-art learning methods have a number of drawbacks when facing real distributed problems, in which the available information is usually private, partial, biased and evolving over time. Federated learning is a popular framework that allows multiple distributed devices to train models remotely, collaboratively, and preserving data privacy. However, the current proposals in federated learning focus on deep architectures that in many cases are not feasible to implement in non-dedicated devices such as smartphones. Also, little research has been done regarding the scenario where data distribution changes over time in unforeseen ways, causing what is known as concept drift. Therefore, in this work we want to present Light Federated and Continual Consensus (LFedCon2), a new federated and continual architecture that uses light, traditional learners. Our method allows powerless devices (such as smartphones or robots) to learn in real time, locally, continuously, autonomously and from users, but also improving models globally, in the cloud, combining what is learned locally, in the devices. In order to test our proposal, we have applied it in a heterogeneous community of smartphone users to solve the problem of walking recognition. The results show the advantages that LFedCon2 provides with respect to other state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑