arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.13010cs.LGstat.AP
收藏

一种基于Web的联邦学习解决方案:结合基于LLM的自动化

A Web-Based Solution for Federated Learning with LLM-Based Automation

Centre of Wireless Communications, University of Oulu(奥卢大学无线通信中心)

Chamith Mawela, Chaouki Ben Issaid, Mehdi Bennis

AI总结:

本文提出一种结合基于意图LLM自动化的Web端联邦学习解决方案,支持FedAvg算法并优化通信与性能,通过LLM自动化减少传输量和CPU时间,并利用NAS与HPO提升测试准确率10-20%。

摘要:

联邦学习(FL)为跨分布式设备的协作机器学习提供了一种有前景的方法。然而,其采用受到构建可靠通信架构的复杂性以及需要机器学习和网络编程双重专业知识的阻碍。本文提出了一个综合解决方案,简化了FL任务的编排,同时集成了基于意图的自动化。我们开发了一个用户友好的Web应用程序,支持联邦平均(FedAvg)算法,使用户能够通过直观的界面配置参数。后端解决方案高效管理参数服务器与边缘节点之间的通信。我们还实现了模型压缩和调度算法以优化FL性能。此外,我们使用在定制数据集上微调的语言模型(LLM)探索了FL中基于意图的自动化,允许用户使用高级提示执行FL任务。我们观察到,基于LLM的自动化解决方案实现了与标准Web解决方案相当的测试准确率,同时将FL任务传输的字节数减少高达64%,CPU时间减少高达46%。同时,我们利用LLM进行神经架构搜索(NAS)和超参数优化(HPO)以提升性能。我们观察到,通过这种方法,所执行的FL任务的测试准确率可提高10-20%。

英文摘要:

Federated Learning (FL) offers a promising approach for collaborative machine learning across distributed devices. However, its adoption is hindered by the complexity of building reliable communication architectures and the need for expertise in both machine learning and network programming. This paper presents a comprehensive solution that simplifies the orchestration of FL tasks while integrating intent-based automation. We develop a user-friendly web application supporting the federated averaging (FedAvg) algorithm, enabling users to configure parameters through an intuitive interface. The backend solution efficiently manages communication between the parameter server and edge nodes. We also implement model compression and scheduling algorithms to optimize FL performance. Furthermore, we explore intent-based automation in FL using a fine-tuned Language Model (LLM) trained on a tailored dataset, allowing users to conduct FL tasks using high-level prompts. We observe that the LLM-based automated solution achieves comparable test accuracy to the standard web-based solution while reducing transferred bytes by up to 64% and CPU time by up to 46% for FL tasks. Also, we leverage the neural architecture search (NAS) and hyperparameter optimization (HPO) using LLM to improve the performance. We observe that by using this approach test accuracy can be improved by 10-20% for the carried out FL tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑