arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.14528cs.LG
收藏

一种有效且高效的绿色联邦学习方法用于单层神经网络

An effective and efficient green federated learning method for one-layer neural networks

Universidade da Coruña(科鲁尼亚大学);CITIC(CITIC研究中心)

Oscar Fontenla-Romero, Bertha Guijarro-Berdiñas, Elena Hernández-Pereira, Beatriz Pérez-Sánchez

AI总结:

提出一种基于无隐藏层神经网络的联邦学习方法,单轮训练即可生成全局模型,在大型数据集上保持竞争力,并显著节省能源。

摘要:

如今,机器学习算法的复杂性持续增长,需要大量的计算资源和能源。因此,人们越来越意识到开发新的绿色算法的重要性,而分布式人工智能可以为此做出贡献。联邦学习(FL)是机器学习中最活跃的研究方向之一,因为它允许以分布式方式训练协作模型,这在许多现实环境中(如物联网)是一个有趣的选择,使得这些模型可以在边缘计算设备上使用。在这项工作中,我们提出了一种基于无隐藏层神经网络的联邦学习方法,能够在单轮训练中生成全局协作模型,这与需要多轮才能收敛的传统联邦学习方法不同。这使得我们能够获得一个有效且高效的模型,简化了训练过程的管理。此外,该方法在设计上保护数据隐私,这是当前数据保护法规中的一个关键方面。我们使用大型数据集和大量联邦客户端进行了实验。尽管基于无隐藏层的网络模型,但在所有情况下,它都能保持与更复杂的先进机器学习模型相比具有竞争力的准确率结果。此外,我们表明该方法在独立同分布和非独立同分布场景下表现同样出色。最后,它是一种环保算法,因为与集中式对应方法相比,它在训练过程中能够显著节省能源。

英文摘要:

Nowadays, machine learning algorithms continue to grow in complexity and require a substantial amount of computational resources and energy. For these reasons, there is a growing awareness of the development of new green algorithms and distributed AI can contribute to this. Federated learning (FL) is one of the most active research lines in machine learning, as it allows the training of collaborative models in a distributed way, an interesting option in many real-world environments, such as the Internet of Things, allowing the use of these models in edge computing devices. In this work, we present a FL method, based on a neural network without hidden layers, capable of generating a global collaborative model in a single training round, unlike traditional FL methods that require multiple rounds for convergence. This allows obtaining an effective and efficient model that simplifies the management of the training process. Moreover, this method preserve data privacy by design, a crucial aspect in current data protection regulations. We conducted experiments with large datasets and a large number of federated clients. Despite being based on a network model without hidden layers, it maintains in all cases competitive accuracy results compared to more complex state-of-the-art machine learning models. Furthermore, we show that the method performs equally well in both identically and non-identically distributed scenarios. Finally, it is an environmentally friendly algorithm as it allows significant energy savings during the training process compared to its centralized counterpart.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑